Feb 27 01:56:31 devstack cinder-volume[73388]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73388) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 01:56:31 devstack cinder-volume[73388]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73388) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 01:56:31 devstack cinder-volume[73388]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73388) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 01:56:32 devstack cinder-volume[73388]: INFO dbcounter [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Registered counter for database cinder Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_db.sqlalchemy.engines [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73388) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG dbcounter [-] [73388] Writer thread running {{(pid=73388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 01:56:32 devstack cinder-volume[73388]: INFO cinder.rpc [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 01:56:32 devstack cinder-volume[73388]: INFO cinder.rpc [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_db.sqlalchemy.engines [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73388) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:56:32 devstack cinder-volume[73388]: INFO cinder.volume.manager [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Determined volume DB was empty at startup. Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG cinder.volume.manager [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73388) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 01:56:32 devstack cinder-volume[73388]: INFO cinder.volume.manager [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 27 01:56:32 devstack cinder-volume[73388]: WARNING stevedore.named [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 01:56:32 devstack cinder-volume[73388]: WARNING castellan.key_manager [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 01:56:32 devstack cinder-volume[73388]: WARNING cinder.keymgr.conf_key_mgr [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG cinder.volume.drivers.lvm [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73388) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_concurrency.processutils [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_concurrency.processutils [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] CMD "cinder-rtstool verify" returned: 0 in 0.253s {{(pid=73388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_db.sqlalchemy.engines [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73388) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:56:32 devstack cinder-volume[73388]: INFO cinder.rpc [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Feb 27 01:56:32 devstack cinder-volume[73388]: INFO cinder.rpc [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Feb 27 01:56:32 devstack cinder-volume[73388]: WARNING stevedore.named [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 01:56:32 devstack cinder-volume[73388]: WARNING castellan.key_manager [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 01:56:32 devstack cinder-volume[73388]: INFO cinder.volume.manager [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_db.sqlalchemy.engines [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73388) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:56:32 devstack cinder-volume[73388]: INFO oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Starting 1 workers Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Started child 73489 {{(pid=73388) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Full set of CONF: {{(pid=73388) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] ******************************************************************************** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Configuration options gathered from: {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] ================================================================================ {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] allow_availability_zone_fallback = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73489]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] allow_compression_on_image_upload = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] allowed_direct_url_schemes = [] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] api_rate_limit = True {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] auth_strategy = keystone {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] az_cache_duration = 3600 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_availability_zone = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_host = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_name = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_stats_polling_interval = 60 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backup_api_class = cinder.backup.api.API {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backup_name_template = backup-%s {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backup_use_same_host = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backup_use_temp_snapshot = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] chap_password = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] chap_username = {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cinder_internal_tenant_project_id = c00dc3cd79b244e298e5a390740c1482 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cinder_internal_tenant_user_id = 22aaeb3a82954f6cad70ae3d30a10257 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cloned_volume_same_az = True {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cluster = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] compression_format = gzip {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] compute_api_class = cinder.compute.nova.API {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] config_dir = [] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] config_source = [] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] control_exchange = openstack {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] debug = True {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] default_availability_zone = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] default_group_type = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] default_volume_type = lvmdriver-1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] disk_geometry = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] driver_client_cert = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] driver_client_cert_key = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] driver_data_namespace = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] driver_ssl_cert_path = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] driver_ssl_cert_verify = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] driver_use_ssl = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] enable_force_upload = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] enable_new_services = True {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] enable_unsupported_driver = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] enabled_backends = ['lvmdriver-1'] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] enforce_multipath_for_image_xfer = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] filter_function = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance_api_insecure = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance_api_servers = ['http://192.168.122.190/image'] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance_api_ssl_compression = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance_ca_certificates_file = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance_catalog_info = image:glance:publicURL {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance_certfile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance_keyfile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance_num_retries = 3 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance_request_timeout = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] goodness_function = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] graceful_shutdown_timeout = 5 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] group_api_class = cinder.group.api.API {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] host = devstack {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] image_compress_on_upload = True {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] image_conversion_address_space_limit = 1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] image_conversion_cpu_limit = 60 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] image_conversion_disable = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] image_upload_use_cinder_backend = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] image_upload_use_internal_tenant = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] image_volume_cache_enabled = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] image_volume_cache_max_count = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] image_volume_cache_max_size_gb = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] init_host_max_objects_retrieval = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] instance_format = [instance: %(uuid)s] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] iscsi_target_flags = {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73489]: INFO cinder.volume.manager [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Starting volume driver LVMVolumeDriver (3.0.0) Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] iscsi_write_cache = on {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] iser_helper = tgtadm {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] iser_ip_address = 192.168.122.190 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] iser_port = 3260 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] log_color = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] log_config_append = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] log_dir = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] log_file = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] log_options = True {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] log_rotate_interval = 1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] log_rotate_interval_type = days {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] log_rotation_type = none {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] max_age = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] max_logfile_count = 30 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] max_logfile_size_mb = 200 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] max_over_subscription_ratio = 20.0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] message_reap_interval = 86400 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] message_ttl = 2592000 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] migration_create_volume_timeout_secs = 300 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] monkey_patch = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] monkey_patch_modules = [] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] my_ip = 192.168.122.190 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] no_snapshot_gb_quota = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] num_iser_scan_tries = 3 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] num_shell_tries = 3 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] num_volume_device_scan_tries = 3 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] nvmeof_conn_info_version = 1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] nvmet_ns_id = 10 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] nvmet_port_id = 1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] osapi_max_limit = 1000 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] osapi_volume_ext_list = [] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] osapi_volume_listen_port = 8776 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] osapi_volume_use_ssl = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] osapi_volume_workers = 2 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] per_volume_size_limit = -1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] periodic_fuzzy_delay = 60 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] periodic_interval = 60 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] public_endpoint = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] publish_errors = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] quota_backup_gigabytes = 1000 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] quota_backups = 10 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] quota_gigabytes = 1000 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] quota_groups = 10 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] quota_snapshots = 10 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] quota_volumes = 10 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] rate_limit_burst = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] rate_limit_except_level = CRITICAL {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] rate_limit_interval = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] reinit_driver_count = 3 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] replication_device = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] report_discard_supported = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] report_interval = 120 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] reservation_clean_interval = 86400 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] reservation_expire = 86400 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] reserved_image_namespaces = [] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] reserved_percentage = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] rpc_response_timeout = 120 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] run_external_periodic_tasks = True {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] scst_target_driver = iscsi {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] scst_target_iqn_name = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] service_down_time = 720 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] shell_completion = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] snapshot_name_template = snapshot-%s {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] snapshot_same_host = True {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] split_loggers = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] state_path = /opt/stack/data/cinder {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] storage_availability_zone = nova {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] storage_protocol = iSCSI {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] syslog_log_facility = LOG_USER {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] target_helper = lioadm {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] target_ip_address = 192.168.122.190 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] target_port = 3260 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] target_protocol = iscsi {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] target_secondary_ip_addresses = [] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] trace_flags = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] transport_url = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] until_refresh = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] use_chap_auth = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] use_default_quota_class = True {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] use_journal = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] use_json = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] use_multipath_for_image_xfer = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] use_stderr = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] use_syslog = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] verify_glance_signatures = enabled {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] volume_api_class = cinder.volume.api.API {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] volume_backend_name = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] volume_clear = zero {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] volume_clear_ionice = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] volume_clear_size = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] volume_copy_bps_limit = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] volume_dd_blocksize = 1M {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] volume_name_template = volume-%s {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] volume_service_inithost_offload = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] volume_usage_audit_period = month {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] zoning_mode = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_concurrency.disable_process_locking = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.admin_password = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.admin_token = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.admin_user = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.auth_admin_prefix = {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.auth_port = 35357 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.auth_protocol = https {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.auth_section = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.auth_type = password {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.auth_uri = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.auth_version = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.cache = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.certfile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.identity_uri = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.include_service_catalog = True {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.insecure = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.interface = public {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.keyfile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.memcache_password = {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:32 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.memcache_username = {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.region_name = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.service_type = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.190/identity {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.backend = dogpile.cache.null {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.backend_argument = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.backend_expiration_time = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.config_prefix = cache.oslo {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.debug_cache_backend = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.enable_retry_client = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.enable_socket_keepalive = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.enabled = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.enforce_fips_mode = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.expiration_time = 600 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.hashclient_retry_attempts = 2 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.memcache_dead_retry = 300 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.memcache_pool_maxsize = 10 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.memcache_sasl_enabled = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.password = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.proxies = [] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.redis_db = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.redis_server = localhost:6379 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.retry_attempts = 2 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.retry_delay = 0.0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.socket_keepalive_count = 1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.socket_keepalive_idle = 1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.socket_keepalive_interval = 1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.socket_timeout = 1.0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.tls_allowed_ciphers = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.tls_cafile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.tls_certfile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.tls_enabled = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.tls_keyfile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cache.username = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] coordination.backend_url = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.asyncio_connection = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.asyncio_slave_connection = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.backend = sqlalchemy {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.connection = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.connection_debug = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.connection_parameters = {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.connection_recycle_time = 3600 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.connection_trace = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.db_inc_retry_interval = True {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.db_max_retries = 20 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.db_max_retry_interval = 10 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.db_retry_interval = 1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.max_overflow = 50 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.max_pool_size = 5 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.max_retries = 10 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.mysql_wsrep_sync_wait = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.pool_timeout = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.retry_interval = 10 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.slave_connection = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.sqlite_synchronous = True {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.synchronous_reader = True {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] database.use_db_reconnect = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] profiler.connection_string = messaging:// {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] profiler.enabled = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] profiler.es_doc_type = notification {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] profiler.es_scroll_size = 10000 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] profiler.es_scroll_time = 2m {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] profiler.filter_error_trace = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] profiler.hmac_keys = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] profiler.sentinel_service_name = mymaster {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] profiler.socket_timeout = 0.1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] profiler.trace_requests = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] profiler.trace_sqlalchemy = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] profiler_jaeger.process_tags = {} {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] profiler_jaeger.service_name_prefix = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] profiler_otlp.service_name_prefix = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_policy.enforce_new_defaults = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: WARNING oslo_config.cfg [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_policy.enforce_scope = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_policy.policy_default_rule = default {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_policy.policy_file = policy.yaml {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] privsep_osbrick.group = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] privsep_osbrick.helper_command = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] privsep_osbrick.user = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cinder_sys_admin.group = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cinder_sys_admin.helper_command = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] cinder_sys_admin.user = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] service_user.auth_section = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] service_user.auth_type = password {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] service_user.cafile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] service_user.certfile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] service_user.collect_timing = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] service_user.insecure = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] service_user.keyfile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] service_user.send_service_user_token = True {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] service_user.split_loggers = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] service_user.timeout = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance.auth_section = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance.auth_type = password {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance.certfile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance.collect_timing = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance.insecure = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance.keyfile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance.region_name = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance.split_loggers = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] glance.timeout = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.backend_availability_zone = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack sudo[73493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.chap_password = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack sudo[73493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.chap_username = {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.disk_geometry = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.driver_client_cert = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.driver_client_cert_key = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.driver_data_namespace = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.driver_use_ssl = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.extra_capabilities = {} {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.filter_function = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.goodness_function = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.iscsi_target_flags = {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.iscsi_write_cache = on {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.iser_helper = tgtadm {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.iser_ip_address = 192.168.122.190 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.iser_port = 3260 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.lvm_mirrors = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.lvm_share_target = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.lvm_type = auto {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.num_shell_tries = 3 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.replication_device = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.report_discard_supported = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.reserved_percentage = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.target_helper = tgtadm {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.target_ip_address = 192.168.122.190 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.target_port = 3260 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.target_protocol = iscsi {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.trace_flags = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.unique_fqdn_network = True {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.use_chap_auth = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.volume_backend_name = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.volume_clear = zero {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.volume_clear_ionice = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.volume_clear_size = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.volume_group = cinder-volumes {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_reports.file_event_handler = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_reports.log_dir = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.backend_host = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.chap_password = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.chap_username = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.chiscsi_conf = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.disk_geometry = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.driver_client_cert = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.driver_use_ssl = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.extra_capabilities = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.filter_function = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.goodness_function = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.iser_helper = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.iser_ip_address = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.iser_port = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.lvm_conf_file = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.lvm_mirrors = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.lvm_share_target = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.lvm_type = auto {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.num_shell_tries = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.nvmet_port_id = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.replication_device = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.report_discard_supported = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.reserved_percentage = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.scst_target_driver = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.storage_protocol = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.target_helper = lioadm {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.target_ip_address = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.target_port = 3260 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.target_protocol = iscsi {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.trace_flags = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.use_chap_auth = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.volume_clear = zero {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.volume_clear_size = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] lvmdriver-1.volumes_dir = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.ssl = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_notifications.driver = [] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_notifications.retry = -1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] key_manager.fixed_key = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican.barbican_api_version = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican.barbican_endpoint = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican.barbican_endpoint_type = public {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican.barbican_region_name = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican.cafile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican.certfile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican.collect_timing = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican.insecure = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican.keyfile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican.number_of_retries = 60 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican.retry_delay = 1 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican.send_service_user_token = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican.split_loggers = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican.timeout = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican.verify_ssl = True {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican.verify_ssl_path = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican_service_user.auth_section = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican_service_user.auth_type = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican_service_user.cafile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican_service_user.certfile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican_service_user.collect_timing = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican_service_user.insecure = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican_service_user.keyfile = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican_service_user.split_loggers = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] barbican_service_user.timeout = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] vault.approle_role_id = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] vault.approle_secret_id = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] vault.kv_mountpoint = secret {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] vault.kv_path = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] vault.kv_version = 2 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] vault.namespace = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] vault.root_token_id = **** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] vault.ssl_ca_crt_file = None {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] vault.timeout = 60.0 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] vault.use_ssl = False {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:32 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] ******************************************************************************** {{(pid=73388) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 01:56:33 devstack sudo[73493]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:33 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:33 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:33 devstack sudo[73785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:33 devstack sudo[73785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:34 devstack sudo[73785]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:34 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.584s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:34 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 01:56:34 devstack cinder-volume[73489]: INFO cinder.brick.local_dev.lvm [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Feb 27 01:56:34 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:34 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:34 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:34 devstack sudo[74007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:56:34 devstack sudo[74007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:34 devstack sudo[74007]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:34 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:34 devstack cinder-volume[73489]: DEBUG cinder.brick.local_dev.lvm [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73489) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Feb 27 01:56:34 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:34 devstack sudo[74043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:34 devstack sudo[74043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:35 devstack sudo[74043]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:35 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.883s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:35 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:35 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:35 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:35 devstack sudo[74174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:35 devstack sudo[74174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:36 devstack sudo[74174]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:36 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.451s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:36 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:36 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:36 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:36 devstack sudo[74178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Feb 27 01:56:36 devstack sudo[74178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:36 devstack sudo[74178]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:36 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.471s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:36 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:36 devstack sudo[74183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:56:36 devstack sudo[74183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:37 devstack sudo[74183]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:37 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:37 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:37 devstack sudo[74186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:56:37 devstack sudo[74186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:37 devstack sudo[74186]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:37 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.522s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:37 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:37 devstack sudo[74191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:56:37 devstack sudo[74191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:38 devstack sudo[74191]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:38 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:38 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:38 devstack sudo[74198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:38 devstack sudo[74198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:38 devstack sudo[74198]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:38 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.629s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:38 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:38 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:38 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:38 devstack sudo[74316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:38 devstack sudo[74316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:39 devstack sudo[74316]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:39 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:39 devstack cinder-volume[73489]: INFO cinder.volume.drivers.lvm [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Enabling LVM thin provisioning by default because a thin pool exists. Feb 27 01:56:39 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:39 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:39 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:39 devstack sudo[74390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:39 devstack sudo[74390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:39 devstack sudo[74390]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:39 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.543s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:39 devstack cinder-volume[73489]: DEBUG cinder.volume.drivers.lvm [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Updating volume stats {{(pid=73489) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:56:39 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:39 devstack sudo[74462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:56:39 devstack sudo[74462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:40 devstack sudo[74462]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:40 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:40 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:40 devstack sudo[74465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:56:40 devstack sudo[74465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:40 devstack sudo[74465]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:40 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:40 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:40 devstack sudo[74468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:40 devstack sudo[74468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:41 devstack sudo[74468]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:41 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.484s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:41 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:41 devstack sudo[74473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:56:41 devstack sudo[74473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:41 devstack sudo[74473]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:41 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.518s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:41 devstack cinder-volume[73489]: INFO cinder.volume.driver [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Driver hasn't implemented _init_vendor_properties() Feb 27 01:56:41 devstack cinder-volume[73489]: DEBUG cinder.volume.driver [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73489) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 01:56:41 devstack cinder-volume[73489]: DEBUG oslo_db.sqlalchemy.engines [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73489) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:56:41 devstack cinder-volume[73489]: DEBUG dbcounter [-] [73489] Writer thread running {{(pid=73489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 01:56:41 devstack cinder-volume[73489]: DEBUG cinder.db.sqlalchemy.api [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Building query based on filter {{(pid=73489) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 01:56:41 devstack cinder-volume[73489]: DEBUG cinder.image.image_utils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73489) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 01:56:41 devstack cinder-volume[73489]: INFO cinder.keymgr.migration [None req-e33aafc8-e26d-48af-bbd3-93b3ea98d284 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 01:56:41 devstack cinder-volume[73489]: DEBUG cinder.volume.drivers.lvm [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Updating volume stats {{(pid=73489) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:56:41 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:41 devstack sudo[74480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:56:41 devstack sudo[74480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:42 devstack sudo[74480]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:42 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.526s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:42 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:42 devstack sudo[74486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:56:42 devstack sudo[74486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:42 devstack cinder-volume[73388]: DEBUG dbcounter [-] [73388] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:56:42 devstack sudo[74486]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:42 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.510s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:42 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:42 devstack sudo[74492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:42 devstack sudo[74492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:43 devstack sudo[74492]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:43 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.510s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:43 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:43 devstack sudo[74495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:56:43 devstack sudo[74495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:43 devstack sudo[74495]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:43 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.513s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:43 devstack cinder-volume[73489]: DEBUG cinder.manager [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Notifying Schedulers of capabilities ... {{(pid=73489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 01:56:43 devstack cinder-volume[73489]: INFO cinder.volume.manager [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Driver initialization completed successfully. Feb 27 01:56:43 devstack cinder-volume[73489]: INFO cinder.manager [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Initiating service 2 cleanup Feb 27 01:56:43 devstack cinder-volume[73489]: INFO cinder.manager [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Service 2 cleanup completed. Feb 27 01:56:43 devstack cinder-volume[73489]: DEBUG cinder.service [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Creating RPC server for service cinder-volume {{(pid=73489) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 01:56:43 devstack cinder-volume[73489]: DEBUG cinder.service [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73489) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 01:56:43 devstack cinder-volume[73489]: INFO cinder.volume.manager [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Feb 27 01:56:43 devstack cinder-volume[73489]: DEBUG cinder.volume.drivers.lvm [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Updating volume stats {{(pid=73489) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:56:43 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:43 devstack sudo[74555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:56:43 devstack sudo[74555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:44 devstack sudo[74555]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:44 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:44 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:44 devstack sudo[74558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:56:44 devstack sudo[74558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:44 devstack sudo[74558]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:44 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.423s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:44 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:44 devstack sudo[74561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:44 devstack sudo[74561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:45 devstack sudo[74561]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:45 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.442s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:45 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:45 devstack sudo[74564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:56:45 devstack sudo[74564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:45 devstack sudo[74564]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:45 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:45 devstack cinder-volume[73489]: INFO cinder.volume.manager [None req-5759ba88-067b-4ad4-8a10-19a2fa8d20ed None None] Driver post RPC initialization completed successfully. Feb 27 01:56:55 devstack cinder-volume[73489]: DEBUG dbcounter [-] [73489] Writing DB stats cinder:SELECT=3 {{(pid=73489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:56:55 devstack cinder-volume[73489]: DEBUG dbcounter [-] [73489] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=73489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:57:59 devstack cinder-volume[73489]: DEBUG oslo_service.periodic_task [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73489) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 01:57:59 devstack cinder-volume[73489]: DEBUG cinder.volume.drivers.lvm [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Updating volume stats {{(pid=73489) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:57:59 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:59 devstack sudo[79453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:57:59 devstack sudo[79453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:00 devstack sudo[79453]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:00 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:00 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:00 devstack sudo[79457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:58:00 devstack sudo[79457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:00 devstack sudo[79457]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:00 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:00 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:00 devstack sudo[79460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:58:00 devstack sudo[79460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:01 devstack sudo[79460]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:01 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.455s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:01 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:01 devstack sudo[79463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:58:01 devstack sudo[79463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:01 devstack sudo[79463]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:01 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:01 devstack cinder-volume[73489]: DEBUG cinder.manager [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Notifying Schedulers of capabilities ... {{(pid=73489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 01:58:55 devstack cinder-volume[73489]: DEBUG dbcounter [-] [73489] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=73489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:58:59 devstack cinder-volume[73489]: DEBUG oslo_service.periodic_task [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73489) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 01:58:59 devstack cinder-volume[73489]: DEBUG cinder.volume.drivers.lvm [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Updating volume stats {{(pid=73489) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:58:59 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:59 devstack sudo[80549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:58:59 devstack sudo[80549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:00 devstack sudo[80549]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:00 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:00 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:00 devstack sudo[80562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:59:00 devstack sudo[80562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:00 devstack sudo[80562]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:00 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:00 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:00 devstack sudo[80596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:59:00 devstack sudo[80596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:01 devstack sudo[80596]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:01 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.463s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:01 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:01 devstack sudo[80625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:59:01 devstack sudo[80625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:01 devstack sudo[80625]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:01 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:01 devstack cinder-volume[73489]: DEBUG cinder.manager [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Notifying Schedulers of capabilities ... {{(pid=73489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 01:59:59 devstack cinder-volume[73489]: DEBUG oslo_service.periodic_task [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73489) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 01:59:59 devstack cinder-volume[73489]: DEBUG cinder.volume.drivers.lvm [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Updating volume stats {{(pid=73489) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:59:59 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:59 devstack sudo[81969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:59:59 devstack sudo[81969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:00 devstack sudo[81969]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:00 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:00 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:00 devstack sudo[81974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 02:00:00 devstack sudo[81974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:00 devstack sudo[81974]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:00 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:00 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:00 devstack sudo[81983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 02:00:00 devstack sudo[81983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:01 devstack sudo[81983]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:01 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:01 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:01 devstack sudo[82003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 02:00:01 devstack sudo[82003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:01 devstack sudo[82003]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:01 devstack cinder-volume[73489]: DEBUG oslo_concurrency.processutils [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=73489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:01 devstack cinder-volume[73489]: DEBUG cinder.manager [None req-73224906-817e-4179-b74b-41ae8e7c72d1 None None] Notifying Schedulers of capabilities ... {{(pid=73489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:00:28 devstack cinder-volume[73388]: INFO oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Caught SIGTERM, stopping children Feb 27 02:00:28 devstack cinder-volume[73388]: DEBUG oslo_concurrency.lockutils [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Acquiring lock "singleton_lock" {{(pid=73388) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:00:28 devstack cinder-volume[73388]: DEBUG oslo_concurrency.lockutils [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Acquired lock "singleton_lock" {{(pid=73388) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:00:28 devstack cinder-volume[73388]: DEBUG oslo_concurrency.lockutils [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Releasing lock "singleton_lock" {{(pid=73388) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:00:28 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Stop services. {{(pid=73388) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 27 02:00:28 devstack cinder-volume[73388]: DEBUG oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Killing children. {{(pid=73388) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 27 02:00:28 devstack cinder-volume[73388]: INFO oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Waiting on 1 children to exit Feb 27 02:00:28 devstack cinder-volume[73489]: DEBUG oslo_concurrency.lockutils [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Acquiring lock "singleton_lock" {{(pid=73489) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:00:28 devstack cinder-volume[73489]: DEBUG oslo_concurrency.lockutils [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Acquired lock "singleton_lock" {{(pid=73489) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:00:28 devstack cinder-volume[73489]: DEBUG oslo_concurrency.lockutils [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Releasing lock "singleton_lock" {{(pid=73489) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:00:28 devstack cinder-volume[73489]: WARNING amqp [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:00:28 devstack cinder-volume[73489]: WARNING amqp [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:00:28 devstack cinder-volume[73388]: INFO oslo_service.backend._eventlet.service [None req-a78cba3c-75e8-40d3-a3f8-0d71408319d0 None None] Child 73489 exited with status 0 Feb 27 02:00:31 devstack cinder-volume[82700]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82700) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:00:31 devstack cinder-volume[82700]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82700) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:00:31 devstack cinder-volume[82700]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82700) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:00:32 devstack cinder-volume[82700]: INFO dbcounter [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Registered counter for database cinder Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_db.sqlalchemy.engines [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82700) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG dbcounter [-] [82700] Writer thread running {{(pid=82700) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:00:32 devstack cinder-volume[82700]: INFO cinder.rpc [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 02:00:32 devstack cinder-volume[82700]: INFO cinder.rpc [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_db.sqlalchemy.engines [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82700) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:32 devstack cinder-volume[82700]: INFO cinder.volume.manager [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Determined volume DB was empty at startup. Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG cinder.volume.manager [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82700) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 02:00:32 devstack cinder-volume[82700]: INFO cinder.volume.manager [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 27 02:00:32 devstack cinder-volume[82700]: WARNING stevedore.named [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 02:00:32 devstack cinder-volume[82700]: WARNING castellan.key_manager [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:00:32 devstack cinder-volume[82700]: WARNING cinder.keymgr.conf_key_mgr [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:00:32 devstack cinder-volume[82700]: INFO cinder.volume.manager [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_db.sqlalchemy.engines [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82700) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:32 devstack cinder-volume[82700]: INFO oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Starting 1 workers Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Started child 82819 {{(pid=82700) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Full set of CONF: {{(pid=82700) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] ******************************************************************************** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Configuration options gathered from: {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 02:00:32 devstack cinder-volume[82819]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] ================================================================================ {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] allow_availability_zone_fallback = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] allow_compression_on_image_upload = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] allowed_direct_url_schemes = [] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] api_rate_limit = True {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] auth_strategy = keystone {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_availability_zone = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_host = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_name = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_stats_polling_interval = 60 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backup_api_class = cinder.backup.api.API {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backup_name_template = backup-%s {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backup_use_same_host = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backup_use_temp_snapshot = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] chap_password = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] chap_username = {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cinder_internal_tenant_project_id = c00dc3cd79b244e298e5a390740c1482 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cinder_internal_tenant_user_id = 22aaeb3a82954f6cad70ae3d30a10257 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cluster = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] compression_format = gzip {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] compute_api_class = cinder.compute.nova.API {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] config_dir = [] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] config_source = [] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] control_exchange = openstack {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] debug = True {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] default_availability_zone = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] default_group_type = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] default_volume_type = QuobyteHD {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] disk_geometry = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] driver_client_cert = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] driver_client_cert_key = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] driver_data_namespace = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] driver_ssl_cert_path = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] driver_ssl_cert_verify = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] driver_use_ssl = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] enable_new_services = True {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] enable_unsupported_driver = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] enabled_backends = ['QuobyteHD'] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] enforce_multipath_for_image_xfer = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] filter_function = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance_api_insecure = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance_api_servers = ['http://192.168.122.190/image'] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance_api_ssl_compression = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Starting volume driver QuobyteDriver (1.1.14) Feb 27 02:00:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.remotefs [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82819) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance_ca_certificates_file = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance_catalog_info = image:glance:publicURL {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance_certfile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance_keyfile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance_num_retries = 3 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance_request_timeout = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] goodness_function = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] graceful_shutdown_timeout = 5 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] group_api_class = cinder.group.api.API {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] host = devstack {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] image_compress_on_upload = True {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] image_conversion_address_space_limit = 1 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] image_conversion_cpu_limit = 60 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] image_conversion_disable = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] image_upload_use_cinder_backend = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] image_upload_use_internal_tenant = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] image_volume_cache_enabled = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] image_volume_cache_max_count = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] image_volume_cache_max_size_gb = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] init_host_max_objects_retrieval = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] instance_format = [instance: %(uuid)s] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] iscsi_target_flags = {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] iscsi_write_cache = on {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] iser_helper = tgtadm {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] iser_ip_address = 192.168.122.190 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] iser_port = 3260 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] log_color = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] log_config_append = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] log_dir = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] log_file = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] log_options = True {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] log_rotate_interval = 1 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] log_rotate_interval_type = days {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] log_rotation_type = none {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] max_age = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] max_logfile_count = 30 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] max_logfile_size_mb = 200 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] max_over_subscription_ratio = 20.0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] message_reap_interval = 86400 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] message_ttl = 2592000 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] migration_create_volume_timeout_secs = 300 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] monkey_patch = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] monkey_patch_modules = [] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] my_ip = 192.168.122.190 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] no_snapshot_gb_quota = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] num_iser_scan_tries = 3 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] num_shell_tries = 3 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] num_volume_device_scan_tries = 3 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] nvmeof_conn_info_version = 1 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] nvmet_ns_id = 10 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] nvmet_port_id = 1 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] osapi_max_limit = 1000 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] osapi_volume_ext_list = [] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] osapi_volume_listen_port = 8776 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] osapi_volume_use_ssl = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] osapi_volume_workers = 2 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] per_volume_size_limit = -1 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] periodic_fuzzy_delay = 60 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] periodic_interval = 60 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] public_endpoint = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] publish_errors = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] quota_backup_gigabytes = 1000 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] quota_backups = 10 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] quota_gigabytes = 1000 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] quota_groups = 10 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] quota_snapshots = 10 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] quota_volumes = 10 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] rate_limit_burst = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] rate_limit_except_level = CRITICAL {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] rate_limit_interval = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] reinit_driver_count = 3 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] replication_device = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] report_discard_supported = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] report_interval = 120 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] reservation_clean_interval = 86400 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] reservation_expire = 86400 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] reserved_image_namespaces = [] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] reserved_percentage = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] rpc_response_timeout = 120 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] run_external_periodic_tasks = True {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82819) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 27 02:00:32 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.quobyte [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 27 02:00:32 devstack cinder-volume[82819]: WARNING cinder.volume.drivers.quobyte [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] scst_target_driver = iscsi {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] scst_target_iqn_name = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Running cmd (subprocess): mount.quobyte {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] service_down_time = 720 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] shell_completion = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] snapshot_name_template = snapshot-%s {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] split_loggers = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] state_path = /opt/stack/data/cinder {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] storage_availability_zone = nova {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] storage_protocol = iSCSI {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] syslog_log_facility = LOG_USER {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] target_helper = lioadm {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] target_ip_address = 192.168.122.190 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] target_port = 3260 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] target_protocol = iscsi {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] target_secondary_ip_addresses = [] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] trace_flags = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] transport_url = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] until_refresh = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] use_chap_auth = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] use_default_quota_class = True {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] use_journal = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] use_json = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] use_multipath_for_image_xfer = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] use_stderr = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] use_syslog = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] verify_glance_signatures = enabled {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] volume_api_class = cinder.volume.api.API {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] volume_backend_name = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] volume_clear = zero {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] volume_clear_ionice = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] volume_clear_size = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] volume_copy_bps_limit = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] volume_dd_blocksize = 1M {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] volume_name_template = volume-%s {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] volume_service_inithost_offload = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] volume_usage_audit_period = month {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] zoning_mode = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_concurrency.disable_process_locking = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.admin_password = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.admin_token = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.admin_user = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.auth_port = 35357 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.auth_protocol = https {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.auth_section = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.auth_type = password {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.auth_uri = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.auth_version = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.cache = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.certfile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.identity_uri = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.include_service_catalog = True {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.insecure = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.interface = public {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.keyfile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.memcache_password = {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.memcache_username = {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.region_name = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.service_type = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.190/identity {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.backend = dogpile.cache.null {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.backend_argument = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.backend_expiration_time = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.config_prefix = cache.oslo {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.debug_cache_backend = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.enable_retry_client = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.enable_socket_keepalive = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.enabled = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.enforce_fips_mode = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.expiration_time = 600 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.hashclient_retry_attempts = 2 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.memcache_dead_retry = 300 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.memcache_pool_maxsize = 10 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.memcache_sasl_enabled = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.password = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.proxies = [] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.redis_db = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.redis_server = localhost:6379 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.retry_attempts = 2 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.retry_delay = 0.0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.socket_keepalive_count = 1 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.socket_keepalive_idle = 1 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.socket_keepalive_interval = 1 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.socket_timeout = 1.0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.tls_allowed_ciphers = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.tls_cafile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.tls_certfile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.tls_enabled = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.tls_keyfile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cache.username = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] coordination.backend_url = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.asyncio_connection = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.asyncio_slave_connection = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.backend = sqlalchemy {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.connection = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack quobyte-client[82820]: Reading configuration file: /etc/quobyte/client.cfg Feb 27 02:00:32 devstack quobyte-client[82820]: Invalid parameters found, error: missing mount point. Feb 27 02:00:32 devstack quobyte-client[82820]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 27 02:00:32 devstack quobyte-client[82820]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.connection_debug = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.connection_parameters = {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.connection_recycle_time = 3600 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.connection_trace = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.db_inc_retry_interval = True {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.db_max_retries = 20 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.db_max_retry_interval = 10 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.db_retry_interval = 1 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.max_overflow = 50 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.max_pool_size = 5 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.max_retries = 10 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.mysql_wsrep_sync_wait = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.pool_timeout = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.retry_interval = 10 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.slave_connection = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.sqlite_synchronous = True {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.synchronous_reader = True {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] database.use_db_reconnect = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] profiler.connection_string = messaging:// {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] profiler.enabled = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] profiler.es_doc_type = notification {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] CMD "mount.quobyte" returned: 1 in 0.080s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] profiler.es_scroll_size = 10000 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] profiler.es_scroll_time = 2m {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] profiler.filter_error_trace = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:32 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] profiler.hmac_keys = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] profiler.sentinel_service_name = mymaster {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82819]: INFO cinder.volume.drivers.quobyte [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa ... Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] profiler.socket_timeout = 0.1 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 -c /etc/quobyte/client-cinder.cfg {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] profiler.trace_requests = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] profiler.trace_sqlalchemy = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] profiler_jaeger.process_tags = {} {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] profiler_jaeger.service_name_prefix = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] profiler_otlp.service_name_prefix = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_policy.enforce_new_defaults = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: WARNING oslo_config.cfg [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_policy.enforce_scope = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_policy.policy_default_rule = default {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_policy.policy_file = policy.yaml {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] privsep_osbrick.group = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] privsep_osbrick.helper_command = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] privsep_osbrick.user = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cinder_sys_admin.group = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cinder_sys_admin.helper_command = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] cinder_sys_admin.user = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] service_user.auth_section = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] service_user.auth_type = password {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] service_user.cafile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] service_user.certfile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] service_user.collect_timing = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] service_user.insecure = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] service_user.keyfile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack sudo[82821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 -c /etc/quobyte/client-cinder.cfg Feb 27 02:00:32 devstack sudo[82821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] service_user.send_service_user_token = True {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] service_user.split_loggers = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] service_user.timeout = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance.auth_section = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance.auth_type = password {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance.certfile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance.collect_timing = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance.insecure = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance.keyfile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance.region_name = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance.split_loggers = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] glance.timeout = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.backend_availability_zone = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.chap_password = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.chap_username = {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.disk_geometry = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.driver_client_cert = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.driver_client_cert_key = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.driver_data_namespace = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.driver_use_ssl = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.extra_capabilities = {} {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.filter_function = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.goodness_function = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.iscsi_target_flags = {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.iscsi_write_cache = on {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.iser_helper = tgtadm {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.iser_ip_address = 192.168.122.190 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.iser_port = 3260 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.nas_host = {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.nas_login = admin {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.nas_mount_options = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.nas_password = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.nas_private_key = {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.nas_share_path = {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.num_shell_tries = 3 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.quobyte_volume_url = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.replication_device = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.report_discard_supported = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.reserved_percentage = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.target_helper = tgtadm {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.target_ip_address = 192.168.122.190 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.target_port = 3260 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.target_protocol = iscsi {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.trace_flags = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.unique_fqdn_network = True {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.use_chap_auth = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.volume_backend_name = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.volume_clear = zero {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.volume_clear_ionice = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.volume_clear_size = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_reports.file_event_handler = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_reports.log_dir = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.backend_availability_zone = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.backend_host = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.chap_password = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.chap_username = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.chiscsi_conf = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.disk_geometry = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.driver_client_cert = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.driver_data_namespace = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.driver_use_ssl = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.extra_capabilities = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.filter_function = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.goodness_function = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.iser_helper = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.iser_ip_address = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.iser_port = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.iser_target_prefix = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.nas_host = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.nas_login = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.nas_mount_options = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.nas_password = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.nas_private_key = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.nas_share_path = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.nas_ssh_port = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.num_shell_tries = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.nvmet_port_id = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.replication_device = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.report_discard_supported = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.reserved_percentage = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.scst_target_driver = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.storage_protocol = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.target_helper = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.target_ip_address = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.target_port = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.target_prefix = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.target_protocol = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.trace_flags = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.use_chap_auth = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.volume_clear = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.volume_clear_size = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] QuobyteHD.volumes_dir = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.ssl = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_notifications.driver = [] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_notifications.retry = -1 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] key_manager.fixed_key = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican.barbican_api_version = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican.barbican_endpoint = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican.barbican_endpoint_type = public {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican.barbican_region_name = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican.cafile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican.certfile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican.collect_timing = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican.insecure = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican.keyfile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican.number_of_retries = 60 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican.retry_delay = 1 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican.send_service_user_token = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican.split_loggers = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican.timeout = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican.verify_ssl = True {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican.verify_ssl_path = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican_service_user.auth_section = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican_service_user.auth_type = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican_service_user.cafile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican_service_user.certfile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican_service_user.collect_timing = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican_service_user.insecure = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican_service_user.keyfile = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican_service_user.split_loggers = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] barbican_service_user.timeout = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] vault.approle_role_id = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] vault.approle_secret_id = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] vault.kv_mountpoint = secret {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] vault.kv_path = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] vault.kv_version = 2 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] vault.namespace = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] vault.root_token_id = **** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] vault.ssl_ca_crt_file = None {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] vault.timeout = 60.0 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] vault.use_ssl = False {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:32 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] ******************************************************************************** {{(pid=82700) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 02:00:33 devstack sudo[82821]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.529s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:33 devstack cinder-volume[82819]: INFO cinder.volume.drivers.quobyte [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa succeeded Feb 27 02:00:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.536s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:33 devstack sudo[82890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:00:33 devstack sudo[82890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:33 devstack sudo[82890]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.416s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:33 devstack cinder-volume[82819]: INFO cinder.volume.driver [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Driver hasn't implemented _init_vendor_properties() Feb 27 02:00:33 devstack cinder-volume[82819]: DEBUG cinder.volume.driver [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82819) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 02:00:33 devstack cinder-volume[82819]: DEBUG oslo_db.sqlalchemy.engines [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82819) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:33 devstack cinder-volume[82819]: DEBUG dbcounter [-] [82819] Writer thread running {{(pid=82819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:00:33 devstack cinder-volume[82819]: DEBUG cinder.db.sqlalchemy.api [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Building query based on filter {{(pid=82819) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 02:00:33 devstack cinder-volume[82819]: DEBUG cinder.image.image_utils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82819) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 02:00:33 devstack cinder-volume[82819]: INFO cinder.keymgr.migration [None req-ee376fd6-3e1d-451f-8782-393acc93cd98 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 02:00:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:33 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:33 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:33 devstack sudo[82893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:00:33 devstack sudo[82893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:34 devstack sudo[82893]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.426s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:34 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:00:34 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Driver initialization completed successfully. Feb 27 02:00:34 devstack cinder-volume[82819]: INFO cinder.manager [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Initiating service 3 cleanup Feb 27 02:00:34 devstack cinder-volume[82819]: INFO cinder.manager [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Service 3 cleanup completed. Feb 27 02:00:34 devstack cinder-volume[82819]: DEBUG cinder.service [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Creating RPC server for service cinder-volume {{(pid=82819) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 02:00:34 devstack cinder-volume[82819]: DEBUG cinder.service [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82819) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 02:00:34 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 27 02:00:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:34 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:34 devstack sudo[82900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:00:34 devstack sudo[82900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:34 devstack sudo[82900]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:34 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.480s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:34 devstack cinder-volume[82819]: INFO cinder.volume.manager [None req-3b9298b8-4460-494a-a9a6-665d2402c4b8 None None] Driver post RPC initialization completed successfully. Feb 27 02:00:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-98cadee7-48b5-4bf4-a94b-fcea6e7aabea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-98cadee7-48b5-4bf4-a94b-fcea6e7aabea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-98cadee7-48b5-4bf4-a94b-fcea6e7aabea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=82819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:37 devstack cinder-volume[82819]: DEBUG cinder.volume.drivers.quobyte [None req-98cadee7-48b5-4bf4-a94b-fcea6e7aabea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=82819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-98cadee7-48b5-4bf4-a94b-fcea6e7aabea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82819) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:37 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-98cadee7-48b5-4bf4-a94b-fcea6e7aabea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:37 devstack sudo[82963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:00:37 devstack sudo[82963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:38 devstack sudo[82963]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:38 devstack cinder-volume[82819]: DEBUG oslo_concurrency.processutils [None req-98cadee7-48b5-4bf4-a94b-fcea6e7aabea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.447s {{(pid=82819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:38 devstack cinder-volume[82819]: DEBUG cinder.manager [None req-98cadee7-48b5-4bf4-a94b-fcea6e7aabea None None] Notifying Schedulers of capabilities ... {{(pid=82819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:00:41 devstack cinder-volume[82700]: INFO oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Caught SIGTERM, stopping children Feb 27 02:00:41 devstack cinder-volume[82700]: DEBUG oslo_concurrency.lockutils [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Acquiring lock "singleton_lock" {{(pid=82700) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:00:41 devstack cinder-volume[82700]: DEBUG oslo_concurrency.lockutils [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Acquired lock "singleton_lock" {{(pid=82700) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:00:41 devstack cinder-volume[82700]: DEBUG oslo_concurrency.lockutils [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Releasing lock "singleton_lock" {{(pid=82700) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:00:41 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Stop services. {{(pid=82700) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 27 02:00:41 devstack cinder-volume[82700]: DEBUG oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Killing children. {{(pid=82700) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 27 02:00:41 devstack cinder-volume[82700]: INFO oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Waiting on 1 children to exit Feb 27 02:00:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Acquiring lock "singleton_lock" {{(pid=82819) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:00:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Acquired lock "singleton_lock" {{(pid=82819) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:00:42 devstack cinder-volume[82819]: DEBUG oslo_concurrency.lockutils [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Releasing lock "singleton_lock" {{(pid=82819) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:00:42 devstack cinder-volume[82819]: WARNING amqp [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:00:42 devstack cinder-volume[82819]: WARNING amqp [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:00:42 devstack cinder-volume[82700]: INFO oslo_service.backend._eventlet.service [None req-8915627b-b538-4679-b76f-5df5cef9c6b3 None None] Child 82819 exited with status 0 Feb 27 02:00:44 devstack cinder-volume[83033]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83033) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:00:44 devstack cinder-volume[83033]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83033) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:00:44 devstack cinder-volume[83033]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83033) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:00:45 devstack cinder-volume[83033]: INFO dbcounter [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] Registered counter for database cinder Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_db.sqlalchemy.engines [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83033) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG dbcounter [-] [83033] Writer thread running {{(pid=83033) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:00:45 devstack cinder-volume[83033]: INFO cinder.rpc [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 02:00:45 devstack cinder-volume[83033]: INFO cinder.rpc [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_db.sqlalchemy.engines [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83033) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:45 devstack cinder-volume[83033]: INFO cinder.volume.manager [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] Determined volume DB was empty at startup. Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG cinder.volume.manager [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83033) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 02:00:45 devstack cinder-volume[83033]: WARNING stevedore.named [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 02:00:45 devstack cinder-volume[83033]: WARNING castellan.key_manager [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:00:45 devstack cinder-volume[83033]: WARNING cinder.keymgr.conf_key_mgr [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:00:45 devstack cinder-volume[83033]: INFO cinder.volume.manager [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_db.sqlalchemy.engines [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83033) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:45 devstack cinder-volume[83033]: INFO oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] Starting 1 workers Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] Started child 83231 {{(pid=83033) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] Full set of CONF: {{(pid=83033) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] ******************************************************************************** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] Configuration options gathered from: {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] ================================================================================ {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] allow_availability_zone_fallback = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] allow_compression_on_image_upload = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] allowed_direct_url_schemes = [] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] api_rate_limit = True {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] auth_strategy = keystone {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_availability_zone = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_host = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_name = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_stats_polling_interval = 60 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backup_api_class = cinder.backup.api.API {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backup_name_template = backup-%s {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backup_use_same_host = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backup_use_temp_snapshot = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] chap_password = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] chap_username = {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cinder_internal_tenant_project_id = c00dc3cd79b244e298e5a390740c1482 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cinder_internal_tenant_user_id = 22aaeb3a82954f6cad70ae3d30a10257 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cluster = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] compression_format = gzip {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] compute_api_class = cinder.compute.nova.API {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] config_dir = [] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] config_source = [] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] control_exchange = openstack {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83231]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] debug = True {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] default_availability_zone = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] default_group_type = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] default_volume_type = QuobyteHD {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] disk_geometry = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] driver_client_cert = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] driver_client_cert_key = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] driver_data_namespace = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] driver_ssl_cert_path = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] driver_ssl_cert_verify = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] driver_use_ssl = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] enable_new_services = True {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] enable_unsupported_driver = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] enabled_backends = ['QuobyteHD'] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] enforce_multipath_for_image_xfer = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] filter_function = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance_api_insecure = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance_api_servers = ['http://192.168.122.190/image'] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance_api_ssl_compression = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance_ca_certificates_file = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance_catalog_info = image:glance:publicURL {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance_certfile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance_keyfile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance_num_retries = 3 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance_request_timeout = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] goodness_function = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] graceful_shutdown_timeout = 5 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] group_api_class = cinder.group.api.API {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] host = devstack {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] image_compress_on_upload = True {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] image_conversion_address_space_limit = 1 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] image_conversion_cpu_limit = 60 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] image_conversion_disable = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] image_upload_use_cinder_backend = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] image_upload_use_internal_tenant = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] image_volume_cache_enabled = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] image_volume_cache_max_count = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] image_volume_cache_max_size_gb = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] init_host_max_objects_retrieval = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] instance_format = [instance: %(uuid)s] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] iscsi_target_flags = {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] iscsi_write_cache = on {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] iser_helper = tgtadm {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] iser_ip_address = 192.168.122.190 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] iser_port = 3260 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] log_color = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] log_config_append = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] log_dir = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] log_file = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] log_options = True {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] log_rotate_interval = 1 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] log_rotate_interval_type = days {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] log_rotation_type = none {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] max_age = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] max_logfile_count = 30 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] max_logfile_size_mb = 200 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] max_over_subscription_ratio = 20.0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] message_reap_interval = 86400 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] message_ttl = 2592000 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] migration_create_volume_timeout_secs = 300 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] monkey_patch = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] monkey_patch_modules = [] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] my_ip = 192.168.122.190 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] no_snapshot_gb_quota = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:45 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] num_iser_scan_tries = 3 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] num_shell_tries = 3 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] num_volume_device_scan_tries = 3 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] nvmeof_conn_info_version = 1 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] nvmet_ns_id = 10 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] nvmet_port_id = 1 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] osapi_max_limit = 1000 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] osapi_volume_ext_list = [] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] osapi_volume_listen_port = 8776 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] osapi_volume_use_ssl = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] osapi_volume_workers = 2 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] per_volume_size_limit = -1 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] periodic_fuzzy_delay = 60 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] periodic_interval = 60 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] public_endpoint = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Starting volume driver QuobyteDriver (1.1.14) Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83231) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] publish_errors = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] quota_backup_gigabytes = 1000 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] quota_backups = 10 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] quota_gigabytes = 1000 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] quota_groups = 10 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] quota_snapshots = 10 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] quota_volumes = 10 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] rate_limit_burst = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] rate_limit_except_level = CRITICAL {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] rate_limit_interval = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] reinit_driver_count = 3 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] replication_device = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] report_discard_supported = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] report_interval = 120 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] reservation_clean_interval = 86400 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] reservation_expire = 86400 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] reserved_image_namespaces = [] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] reserved_percentage = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] rpc_response_timeout = 120 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] run_external_periodic_tasks = True {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] scst_target_driver = iscsi {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] scst_target_iqn_name = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] service_down_time = 720 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] shell_completion = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] snapshot_name_template = snapshot-%s {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] split_loggers = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] state_path = /opt/stack/data/cinder {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] storage_availability_zone = nova {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] storage_protocol = iSCSI {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] syslog_log_facility = LOG_USER {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] target_helper = lioadm {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] target_ip_address = 192.168.122.190 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] target_port = 3260 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] target_protocol = iscsi {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] target_secondary_ip_addresses = [] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] trace_flags = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] transport_url = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] until_refresh = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] use_chap_auth = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] use_default_quota_class = True {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] use_journal = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] use_json = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] use_multipath_for_image_xfer = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] use_stderr = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] use_syslog = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] verify_glance_signatures = enabled {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] volume_api_class = cinder.volume.api.API {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] volume_backend_name = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] volume_clear = zero {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] volume_clear_ionice = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] volume_clear_size = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] volume_copy_bps_limit = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] volume_dd_blocksize = 1M {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] volume_name_template = volume-%s {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] volume_service_inithost_offload = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] volume_usage_audit_period = month {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] zoning_mode = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_concurrency.disable_process_locking = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.admin_password = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.admin_token = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.admin_user = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.auth_port = 35357 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.auth_protocol = https {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.auth_section = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.auth_type = password {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.auth_uri = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.auth_version = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.cache = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.certfile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.identity_uri = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.include_service_catalog = True {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.insecure = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.interface = public {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.keyfile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.memcache_password = {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.memcache_username = {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.region_name = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.service_type = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.190/identity {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.backend = dogpile.cache.null {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.backend_argument = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.backend_expiration_time = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.config_prefix = cache.oslo {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.debug_cache_backend = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.enable_retry_client = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.enable_socket_keepalive = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.enabled = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.enforce_fips_mode = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.expiration_time = 600 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.hashclient_retry_attempts = 2 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.memcache_dead_retry = 300 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.memcache_pool_maxsize = 10 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.memcache_sasl_enabled = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.password = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.proxies = [] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.redis_db = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.redis_server = localhost:6379 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.retry_attempts = 2 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.retry_delay = 0.0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.socket_keepalive_count = 1 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.socket_keepalive_idle = 1 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.socket_keepalive_interval = 1 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.socket_timeout = 1.0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.tls_allowed_ciphers = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.tls_cafile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.tls_certfile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.tls_enabled = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.tls_keyfile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cache.username = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] coordination.backend_url = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.asyncio_connection = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.asyncio_slave_connection = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.backend = sqlalchemy {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.connection = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.connection_debug = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.connection_parameters = {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.connection_recycle_time = 3600 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.connection_trace = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.db_inc_retry_interval = True {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.db_max_retries = 20 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.db_max_retry_interval = 10 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.db_retry_interval = 1 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.max_overflow = 50 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.max_pool_size = 5 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.max_retries = 10 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.mysql_wsrep_sync_wait = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.pool_timeout = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.retry_interval = 10 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.slave_connection = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.sqlite_synchronous = True {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.synchronous_reader = True {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] database.use_db_reconnect = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] profiler.connection_string = messaging:// {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] profiler.enabled = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] profiler.es_doc_type = notification {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] profiler.es_scroll_size = 10000 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] profiler.es_scroll_time = 2m {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] profiler.filter_error_trace = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] profiler.hmac_keys = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] profiler.sentinel_service_name = mymaster {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] profiler.socket_timeout = 0.1 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] profiler.trace_requests = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] profiler.trace_sqlalchemy = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] profiler_jaeger.process_tags = {} {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] profiler_jaeger.service_name_prefix = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] profiler_otlp.service_name_prefix = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_policy.enforce_new_defaults = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: WARNING oslo_config.cfg [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_policy.enforce_scope = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_policy.policy_default_rule = default {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_policy.policy_file = policy.yaml {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] privsep_osbrick.group = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] privsep_osbrick.helper_command = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] privsep_osbrick.user = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cinder_sys_admin.group = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cinder_sys_admin.helper_command = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] cinder_sys_admin.user = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83231) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 27 02:00:46 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.quobyte [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 27 02:00:46 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.quobyte [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Running cmd (subprocess): mount.quobyte {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] service_user.auth_section = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] service_user.auth_type = password {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] service_user.cafile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] service_user.certfile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] service_user.collect_timing = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] service_user.insecure = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] service_user.keyfile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] service_user.send_service_user_token = True {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] service_user.split_loggers = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] service_user.timeout = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance.auth_section = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance.auth_type = password {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance.certfile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance.collect_timing = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance.insecure = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance.keyfile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance.region_name = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance.split_loggers = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] glance.timeout = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.backend_availability_zone = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.chap_password = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.chap_username = {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.disk_geometry = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.driver_client_cert = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.driver_client_cert_key = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.driver_data_namespace = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.driver_use_ssl = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.extra_capabilities = {} {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.filter_function = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.goodness_function = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.iscsi_target_flags = {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.iscsi_write_cache = on {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.iser_helper = tgtadm {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.iser_ip_address = 192.168.122.190 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.iser_port = 3260 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.nas_host = {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.nas_login = admin {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.nas_mount_options = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.nas_password = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.nas_private_key = {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.nas_share_path = {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.num_shell_tries = 3 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.quobyte_volume_url = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.replication_device = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.report_discard_supported = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.reserved_percentage = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.target_helper = tgtadm {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.target_ip_address = 192.168.122.190 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.target_port = 3260 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.target_protocol = iscsi {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.trace_flags = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.unique_fqdn_network = True {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.use_chap_auth = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.volume_backend_name = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.volume_clear = zero {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.volume_clear_ionice = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.volume_clear_size = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_reports.file_event_handler = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_reports.log_dir = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.backend_availability_zone = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.backend_host = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.chap_password = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.chap_username = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.chiscsi_conf = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.disk_geometry = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.driver_client_cert = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.driver_data_namespace = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.driver_use_ssl = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.extra_capabilities = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.filter_function = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.goodness_function = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.iser_helper = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.iser_ip_address = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.iser_port = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.iser_target_prefix = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.nas_host = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.nas_login = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.nas_mount_options = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.nas_password = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.nas_private_key = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.nas_share_path = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.nas_ssh_port = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.num_shell_tries = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.nvmet_port_id = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.replication_device = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.report_discard_supported = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.reserved_percentage = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.scst_target_driver = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.storage_protocol = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.target_helper = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.target_ip_address = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.target_port = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.target_prefix = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.target_protocol = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.trace_flags = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.use_chap_auth = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.volume_clear = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.volume_clear_size = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] QuobyteHD.volumes_dir = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] CMD "mount.quobyte" returned: 1 in 0.106s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.ssl = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_notifications.driver = [] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack sudo[83249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:00:46 devstack sudo[83249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_notifications.retry = -1 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] key_manager.fixed_key = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican.barbican_api_version = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican.barbican_endpoint = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican.barbican_endpoint_type = public {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican.barbican_region_name = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican.cafile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican.certfile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican.collect_timing = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican.insecure = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican.keyfile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican.number_of_retries = 60 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican.retry_delay = 1 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican.send_service_user_token = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican.split_loggers = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican.timeout = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican.verify_ssl = True {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican.verify_ssl_path = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican_service_user.auth_section = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican_service_user.auth_type = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican_service_user.cafile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican_service_user.certfile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican_service_user.collect_timing = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican_service_user.insecure = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican_service_user.keyfile = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican_service_user.split_loggers = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] barbican_service_user.timeout = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] vault.approle_role_id = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] vault.approle_secret_id = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] vault.kv_mountpoint = secret {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] vault.kv_path = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] vault.kv_version = 2 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] vault.namespace = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] vault.root_token_id = **** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] vault.ssl_ca_crt_file = None {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] vault.timeout = 60.0 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] vault.use_ssl = False {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:46 devstack cinder-volume[83033]: DEBUG oslo_service.backend._eventlet.service [None req-bc65a6c3-a5aa-4100-bf96-79e04ac1c1c3 None None] ******************************************************************************** {{(pid=83033) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 02:00:46 devstack sudo[83249]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.539s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:46 devstack cinder-volume[83231]: INFO cinder.volume.driver [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Driver hasn't implemented _init_vendor_properties() Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG cinder.volume.driver [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83231) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG oslo_db.sqlalchemy.engines [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83231) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writer thread running {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG cinder.db.sqlalchemy.api [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Building query based on filter {{(pid=83231) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83231) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:46 devstack cinder-volume[83231]: INFO cinder.keymgr.migration [None req-fc0fc6e6-ef6b-4865-9e13-dbf4b5f5144c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 02:00:46 devstack sudo[83266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:00:46 devstack sudo[83266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:47 devstack sudo[83266]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.684s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:47 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:00:47 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Driver initialization completed successfully. Feb 27 02:00:47 devstack cinder-volume[83231]: INFO cinder.manager [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Initiating service 3 cleanup Feb 27 02:00:47 devstack cinder-volume[83231]: INFO cinder.manager [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Service 3 cleanup completed. Feb 27 02:00:47 devstack cinder-volume[83231]: DEBUG cinder.service [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Creating RPC server for service cinder-volume {{(pid=83231) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 02:00:47 devstack cinder-volume[83231]: DEBUG cinder.service [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83231) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 02:00:47 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 27 02:00:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:47 devstack sudo[83292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:00:47 devstack sudo[83292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:48 devstack sudo[83292]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.441s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:48 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-c82a266d-387f-40e9-ba80-a4f10f11efd6 None None] Driver post RPC initialization completed successfully. Feb 27 02:00:55 devstack cinder-volume[83033]: DEBUG dbcounter [-] [83033] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83033) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:00:57 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=1 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:00:58 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG oslo_service.periodic_task [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83231) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:47 devstack sudo[83565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:01:47 devstack sudo[83565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:47 devstack sudo[83565]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.551s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Flow 'volume_create_manager' (80203157-fb3b-4871-876f-2f86ad8eaa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3682c1c-a735-440b-a09a-1d06312680f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3682c1c-a735-440b-a09a-1d06312680f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-636647924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d63cda8-a724-4eef-84cd-d9f1b32541b3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b950819faa2d423285e76a934538ad06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:48Z,use_quota=True,user_id='0cf013415c2b47e6a284b16db344e54a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c16739-7a20-4d6b-b18a-1031f4c5c7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c16739-7a20-4d6b-b18a-1031f4c5c7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc8a1e7-d37b-4b73-b6d6-d12029f6eba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc8a1e7-d37b-4b73-b6d6-d12029f6eba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d63cda8-a724-4eef-84cd-d9f1b32541b3', 'volume_name': 'volume-0d63cda8-a724-4eef-84cd-d9f1b32541b3', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60cb9e56-8654-4420-8c4f-97e9564789a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60cb9e56-8654-4420-8c4f-97e9564789a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69a2699-1bf8-4f26-aae7-a49bc4371924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:47 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Volume 0d63cda8-a724-4eef-84cd-d9f1b32541b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d63cda8-a724-4eef-84cd-d9f1b32541b3', 'volume_size': 1} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-636647924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d63cda8-a724-4eef-84cd-d9f1b32541b3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b950819faa2d423285e76a934538ad06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:48Z,use_quota=True,user_id='0cf013415c2b47e6a284b16db344e54a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Creating volume 0d63cda8-a724-4eef-84cd-d9f1b32541b3 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:01:47 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:01:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0d63cda8-a724-4eef-84cd-d9f1b32541b3 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:48 devstack sudo[83570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0d63cda8-a724-4eef-84cd-d9f1b32541b3 1073741824 Feb 27 02:01:48 devstack sudo[83570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:49 devstack sudo[83570]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0d63cda8-a724-4eef-84cd-d9f1b32541b3 1073741824" returned: 0 in 1.140s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0d63cda8-a724-4eef-84cd-d9f1b32541b3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:49 devstack sudo[83891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0d63cda8-a724-4eef-84cd-d9f1b32541b3 Feb 27 02:01:49 devstack sudo[83891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:49 devstack sudo[83891]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0d63cda8-a724-4eef-84cd-d9f1b32541b3" returned: 0 in 0.615s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:01:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69a2699-1bf8-4f26-aae7-a49bc4371924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d63cda8-a724-4eef-84cd-d9f1b32541b3', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa2557d-8e40-4650-93c7-8ca95b97c0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:49 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Volume volume-0d63cda8-a724-4eef-84cd-d9f1b32541b3 (0d63cda8-a724-4eef-84cd-d9f1b32541b3): created successfully Feb 27 02:01:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa2557d-8e40-4650-93c7-8ca95b97c0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Flow 'volume_create_manager' (80203157-fb3b-4871-876f-2f86ad8eaa5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:01:49 devstack cinder-volume[83231]: INFO cinder.volume.manager [req-c249f094-f739-4cf7-801e-1e290b74196e req-d6f0e824-babf-4f7c-a6ea-63669f924cbf tempest-VolumesGetTestJSON-2108998450 None] Created volume successfully. Feb 27 02:01:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Acquiring lock "cinder-0d63cda8-a724-4eef-84cd-d9f1b32541b3-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:01:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Lock "cinder-0d63cda8-a724-4eef-84cd-d9f1b32541b3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:01:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Acquiring lock "cinder-quobyte-0d63cda8-a724-4eef-84cd-d9f1b32541b3" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:01:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Lock "cinder-quobyte-0d63cda8-a724-4eef-84cd-d9f1b32541b3" acquired by "delete_volume" :: waited 0.029s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:01:50 devstack cinder-volume[83231]: INFO oslo.privsep.daemon [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpz4g5y_sb/privsep.sock'] Feb 27 02:01:50 devstack sudo[83897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpz4g5y_sb/privsep.sock Feb 27 02:01:50 devstack sudo[83897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Flow 'volume_create_manager' (c83e8de7-0160-4328-9c1b-0243ef4ff482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5512e455-3490-4c09-a33b-2395478e0756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5512e455-3490-4c09-a33b-2395478e0756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2024911654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eaefda5-3d0e-4598-8437-f0749bbe4ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438a498f6f494041bfb4fc1f12c60ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:51Z,use_quota=True,user_id='0d8c101b705e438b875f0c195dad9553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2a06f3-b914-48c4-9187-508cc907baf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2a06f3-b914-48c4-9187-508cc907baf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54972824-2bb3-4ffb-a2f9-de06e3f51781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54972824-2bb3-4ffb-a2f9-de06e3f51781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eaefda5-3d0e-4598-8437-f0749bbe4ab9', 'volume_name': 'volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7a3c95-adad-4fa5-841f-615c9f9085c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7a3c95-adad-4fa5-841f-615c9f9085c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c3887e-6027-405d-9cdf-b1a76376244e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:51 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Volume 9eaefda5-3d0e-4598-8437-f0749bbe4ab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9', 'volume_size': 1} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2024911654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eaefda5-3d0e-4598-8437-f0749bbe4ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438a498f6f494041bfb4fc1f12c60ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:51Z,use_quota=True,user_id='0d8c101b705e438b875f0c195dad9553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Creating volume 9eaefda5-3d0e-4598-8437-f0749bbe4ab9 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:01:51 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:01:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:51 devstack sudo[83901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9 1073741824 Feb 27 02:01:51 devstack sudo[83901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:52 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:01:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Flow 'volume_create_manager' (c4695d0e-544d-4f03-8631-09a8f5e79a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:01:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5e7d0f-0010-4861-84e5-045adaaca6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5e7d0f-0010-4861-84e5-045adaaca6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-561163512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf38feb8-3b6b-43ad-9b14-a4172dfab517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687bc5c72d8248a2840e36f7fdffb4da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:53Z,use_quota=True,user_id='9ae7a8f2d4924f939a522cb3855f2b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c8721d-f674-4e40-b609-c4c1b2e789e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c8721d-f674-4e40-b609-c4c1b2e789e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588a9c21-7b51-41f8-9cba-d5758d7726c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588a9c21-7b51-41f8-9cba-d5758d7726c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf38feb8-3b6b-43ad-9b14-a4172dfab517', 'volume_name': 'volume-cf38feb8-3b6b-43ad-9b14-a4172dfab517', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01db4357-3c41-4936-a0c2-d2285c40d9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01db4357-3c41-4936-a0c2-d2285c40d9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e340db-3884-4490-9146-39f5cdf6c55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:53 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Volume cf38feb8-3b6b-43ad-9b14-a4172dfab517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf38feb8-3b6b-43ad-9b14-a4172dfab517', 'volume_size': 1} Feb 27 02:01:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:53 devstack sudo[83901]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9 1073741824" returned: 0 in 1.941s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:53 devstack sudo[83910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9 Feb 27 02:01:53 devstack sudo[83910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:53 devstack sudo[83897]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:53 devstack cinder-volume[83231]: INFO oslo.privsep.daemon [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Spawned new privsep daemon via rootwrap Feb 27 02:01:53 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Accepted privsep connection to /tmp/tmpz4g5y_sb/privsep.sock {{(pid=83231) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Feb 27 02:01:53 devstack cinder-volume[83231]: INFO oslo.privsep.daemon [-] privsep daemon starting Feb 27 02:01:53 devstack cinder-volume[83231]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Feb 27 02:01:53 devstack cinder-volume[83231]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Feb 27 02:01:53 devstack cinder-volume[83231]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83907 Feb 27 02:01:53 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a7ad57-5a65-44d4-9a58-d817862ffccf]: (2,) {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:01:53 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c96c19-b0c9-4a0f-8929-b25693bf3254]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:01:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0d63cda8-a724-4eef-84cd-d9f1b32541b3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:53 devstack sudo[83913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0d63cda8-a724-4eef-84cd-d9f1b32541b3 Feb 27 02:01:53 devstack sudo[83913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:54 devstack sudo[83910]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9" returned: 0 in 0.855s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] <== create_volume: return (2871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:01:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.875s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.340s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-561163512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf38feb8-3b6b-43ad-9b14-a4172dfab517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687bc5c72d8248a2840e36f7fdffb4da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:53Z,use_quota=True,user_id='9ae7a8f2d4924f939a522cb3855f2b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:01:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Creating volume cf38feb8-3b6b-43ad-9b14-a4172dfab517 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:01:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:01:54 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:01:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-cf38feb8-3b6b-43ad-9b14-a4172dfab517 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c3887e-6027-405d-9cdf-b1a76376244e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1683c6-a417-4874-a451-ceeb64ccf5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:54 devstack sudo[83916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-cf38feb8-3b6b-43ad-9b14-a4172dfab517 1073741824 Feb 27 02:01:54 devstack sudo[83916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:54 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Volume volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9 (9eaefda5-3d0e-4598-8437-f0749bbe4ab9): created successfully Feb 27 02:01:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1683c6-a417-4874-a451-ceeb64ccf5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Flow 'volume_create_manager' (c83e8de7-0160-4328-9c1b-0243ef4ff482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:01:54 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-55504544-724b-4d3a-94c8-673d4c203454 tempest-DeleteServersTestJSON-1093011018 None] Created volume successfully. Feb 27 02:01:54 devstack sudo[83913]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0d63cda8-a724-4eef-84cd-d9f1b32541b3" returned: 0 in 1.266s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0d63cda8-a724-4eef-84cd-d9f1b32541b3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:54 devstack sudo[83923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0d63cda8-a724-4eef-84cd-d9f1b32541b3 Feb 27 02:01:54 devstack sudo[83923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:55 devstack sudo[83923]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0d63cda8-a724-4eef-84cd-d9f1b32541b3" returned: 0 in 0.719s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:55 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Lock "cinder-quobyte-0d63cda8-a724-4eef-84cd-d9f1b32541b3" released by "delete_volume" :: held 4.901s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:01:55 devstack cinder-volume[83231]: WARNING cinder.quota [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:01:55 devstack cinder-volume[83231]: WARNING cinder.quota [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:01:55 devstack cinder-volume[83231]: DEBUG cinder.quota [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Created reservations ['c2d975ba-a92c-47c2-a533-76052a9666a2', '1a8627f4-ab17-4100-8f15-4a8222bde8a7', 'a9ae120b-604e-4786-9d07-03f1716e77c3', 'aad20731-44d2-4fa0-8e11-0b8a7726fcb2'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:01:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:56 devstack sudo[83929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:01:56 devstack sudo[83929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:56 devstack sudo[83916]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-cf38feb8-3b6b-43ad-9b14-a4172dfab517 1073741824" returned: 0 in 1.644s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-cf38feb8-3b6b-43ad-9b14-a4172dfab517 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:56 devstack sudo[83931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-cf38feb8-3b6b-43ad-9b14-a4172dfab517 Feb 27 02:01:56 devstack sudo[83931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:56 devstack sudo[83931]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-cf38feb8-3b6b-43ad-9b14-a4172dfab517" returned: 0 in 0.716s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:56 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] <== create_volume: return (2418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:01:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.425s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e340db-3884-4490-9146-39f5cdf6c55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf38feb8-3b6b-43ad-9b14-a4172dfab517', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e82e934-7e70-4c85-9077-832f197a63f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:56 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Volume volume-cf38feb8-3b6b-43ad-9b14-a4172dfab517 (cf38feb8-3b6b-43ad-9b14-a4172dfab517): created successfully Feb 27 02:01:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e82e934-7e70-4c85-9077-832f197a63f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Flow 'volume_create_manager' (c4695d0e-544d-4f03-8631-09a8f5e79a37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:01:56 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-6ef8fe0c-1a7e-46d4-90f6-f0e344723610 tempest-VolumesAdminNegativeTest-385629684 None] Created volume successfully. Feb 27 02:01:56 devstack sudo[83929]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 1.047s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:56 devstack cinder-volume[83231]: DEBUG cinder.manager [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:01:57 devstack cinder-volume[83231]: INFO cinder.volume.manager [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Deleted volume successfully. Feb 27 02:01:57 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-eaef2734-bea3-4583-9346-a82ff52539ae req-b7a3e93e-cedf-44e2-9f49-eb84b05584e1 tempest-VolumesGetTestJSON-2108998450 None] Lock "cinder-0d63cda8-a724-4eef-84cd-d9f1b32541b3-delete_volume" released by "delete_volume" :: held 6.312s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:01:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] Acquiring lock "cinder-cf38feb8-3b6b-43ad-9b14-a4172dfab517-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:01:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] Lock "cinder-cf38feb8-3b6b-43ad-9b14-a4172dfab517-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:01:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] Acquiring lock "cinder-quobyte-cf38feb8-3b6b-43ad-9b14-a4172dfab517" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:01:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] Lock "cinder-quobyte-cf38feb8-3b6b-43ad-9b14-a4172dfab517" acquired by "delete_volume" :: waited 0.039s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:01:58 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b7030f-4a4f-4e82-ae18-51bbae6ab9be]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:01:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-cf38feb8-3b6b-43ad-9b14-a4172dfab517 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:58 devstack sudo[83939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-cf38feb8-3b6b-43ad-9b14-a4172dfab517 Feb 27 02:01:58 devstack sudo[83939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:00 devstack sudo[83939]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-cf38feb8-3b6b-43ad-9b14-a4172dfab517" returned: 0 in 1.455s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-cf38feb8-3b6b-43ad-9b14-a4172dfab517 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:00 devstack sudo[83945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-cf38feb8-3b6b-43ad-9b14-a4172dfab517 Feb 27 02:02:00 devstack sudo[83945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:01 devstack sudo[83945]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-cf38feb8-3b6b-43ad-9b14-a4172dfab517" returned: 0 in 1.386s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] Lock "cinder-quobyte-cf38feb8-3b6b-43ad-9b14-a4172dfab517" released by "delete_volume" :: held 2.892s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:01 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] Created reservations ['75dd7b82-8b54-408b-bbac-bec5898f36bb', 'bea906ad-2e0d-4e5e-b248-1a3ec235d2e2', 'cb7f2b08-01b8-40dc-89c9-9bfcd1bb905a', '42309dcf-8c89-4142-98e8-318a074ba0fb'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:01 devstack cinder-volume[83231]: WARNING py.warnings [req-b089db8a-dd7e-4194-9477-e11e9b3e0608 req-f9a8149d-ab1b-46c0-b3ad-e025ff20976c tempest-DeleteServersTestJSON-1093011018 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Feb 27 02:02:01 devstack cinder-volume[83231]: .first() Feb 27 02:02:01 devstack cinder-volume[83231]: Feb 27 02:02:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-b089db8a-dd7e-4194-9477-e11e9b3e0608 req-f9a8149d-ab1b-46c0-b3ad-e025ff20976c tempest-DeleteServersTestJSON-1093011018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-b089db8a-dd7e-4194-9477-e11e9b3e0608 req-f9a8149d-ab1b-46c0-b3ad-e025ff20976c tempest-DeleteServersTestJSON-1093011018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:01 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:01 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:01 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9763673-4512-4caf-a102-506cf2fe453e]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-b089db8a-dd7e-4194-9477-e11e9b3e0608 req-f9a8149d-ab1b-46c0-b3ad-e025ff20976c tempest-DeleteServersTestJSON-1093011018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:01 devstack sudo[83960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:02:01 devstack sudo[83960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:01 devstack sudo[83961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9 Feb 27 02:02:01 devstack sudo[83961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:03 devstack sudo[83960]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 1.319s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:03 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:03 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] Deleted volume successfully. Feb 27 02:02:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cc6769fd-d1a0-41a6-a178-c39797a44ec8 tempest-VolumesAdminNegativeTest-385629684 None] Lock "cinder-cf38feb8-3b6b-43ad-9b14-a4172dfab517-delete_volume" released by "delete_volume" :: held 4.756s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:03 devstack sudo[83961]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-b089db8a-dd7e-4194-9477-e11e9b3e0608 req-f9a8149d-ab1b-46c0-b3ad-e025ff20976c tempest-DeleteServersTestJSON-1093011018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9" returned: 0 in 1.664s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-b089db8a-dd7e-4194-9477-e11e9b3e0608 req-f9a8149d-ab1b-46c0-b3ad-e025ff20976c tempest-DeleteServersTestJSON-1093011018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.742s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-b089db8a-dd7e-4194-9477-e11e9b3e0608 req-f9a8149d-ab1b-46c0-b3ad-e025ff20976c tempest-DeleteServersTestJSON-1093011018 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa', 'name': 'volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54098e09-655e-4e16-9cb0-71f4f9bb5f5f', 'enforce_multipath': True} {{(pid=83231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 02:02:03 devstack cinder-volume[83231]: INFO cinder.volume.manager [req-b089db8a-dd7e-4194-9477-e11e9b3e0608 req-f9a8149d-ab1b-46c0-b3ad-e025ff20976c tempest-DeleteServersTestJSON-1093011018 None] attachment_update completed successfully. Feb 27 02:02:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d0633a52-b0a7-48b0-97b4-8a431a4fea59 tempest-BackendsCapabilitiesAdminTestsJSON-1650550819 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83231) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 27 02:02:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a87a6ad1-6cea-4a9b-937e-df50276419ec tempest-BackendsCapabilitiesAdminTestsJSON-1650550819 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83231) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 27 02:02:13 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=18,cinder:UPDATE=28,cinder:INSERT=3,cinder:DELETE=3 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:02:13 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=25,cinder:UPDATE=25,cinder:INSERT=8,cinder:DELETE=2 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:02:13 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-19be478d-67a6-4d84-8018-321361e44958 tempest-GroupSnapshotsV319Test-881419278 None] Group tempest-GroupSnapshotsV319Test-Group-1994324254: creating Feb 27 02:02:13 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-19be478d-67a6-4d84-8018-321361e44958 tempest-GroupSnapshotsV319Test-881419278 None] Group tempest-GroupSnapshotsV319Test-Group-1994324254: created successfully Feb 27 02:02:13 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-19be478d-67a6-4d84-8018-321361e44958 tempest-GroupSnapshotsV319Test-881419278 None] Create group completed successfully. Feb 27 02:02:14 devstack cinder-volume[83231]: INFO cinder.volume.manager [req-c6882b09-afe8-4dff-9e5a-e015a1c43d38 req-57ce7a3b-0812-4646-bc14-5ddad1a0955f tempest-DeleteServersTestJSON-1093011018 None] Terminate volume connection completed successfully. Feb 27 02:02:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-c6882b09-afe8-4dff-9e5a-e015a1c43d38 req-57ce7a3b-0812-4646-bc14-5ddad1a0955f tempest-DeleteServersTestJSON-1093011018 None] Deleting attachment 54098e09-655e-4e16-9cb0-71f4f9bb5f5f. {{(pid=83231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Flow 'volume_create_manager' (1777510a-74f5-4e82-ba62-f3f5e8cc6aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ace5447-79e0-4df1-bc92-0f37edf6602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ace5447-79e0-4df1-bc92-0f37edf6602a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2117735873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15e8cbd3-6476-4381-8fc3-497090423b1c,host='devstack@QuobyteHD#QuobyteHD',id=dd2a898d-e5cc-4eab-b03b-af50f1782675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cceb0345d24d9aa20d4102188bfe84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:15Z,use_quota=True,user_id='19737d072c854f80a1d8f8fcfb7e9607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a089df87-f504-402f-8428-6263bfab3e26),volume_type_id=a089df87-f504-402f-8428-6263bfab3e26)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75883fc9-d604-491a-93df-8ddad91e17fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75883fc9-d604-491a-93df-8ddad91e17fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d6e8c1-fffd-4fbd-810a-e866d5427582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d6e8c1-fffd-4fbd-810a-e866d5427582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd2a898d-e5cc-4eab-b03b-af50f1782675', 'volume_name': 'volume-dd2a898d-e5cc-4eab-b03b-af50f1782675', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0ed0b2-ad03-41b8-b913-272cfc10a8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0ed0b2-ad03-41b8-b913-272cfc10a8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965e08ac-0550-4b67-b6e8-22cd95735997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:15 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Volume dd2a898d-e5cc-4eab-b03b-af50f1782675: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd2a898d-e5cc-4eab-b03b-af50f1782675', 'volume_size': 1} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=15e8cbd3-6476-4381-8fc3-497090423b1c,created_at=2026-02-27T01:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2117735873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15e8cbd3-6476-4381-8fc3-497090423b1c,host='devstack@QuobyteHD#QuobyteHD',id=dd2a898d-e5cc-4eab-b03b-af50f1782675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cceb0345d24d9aa20d4102188bfe84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:15Z,use_quota=True,user_id='19737d072c854f80a1d8f8fcfb7e9607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a089df87-f504-402f-8428-6263bfab3e26),volume_type_id=a089df87-f504-402f-8428-6263bfab3e26)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Creating volume dd2a898d-e5cc-4eab-b03b-af50f1782675 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:02:15 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:02:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:15 devstack sudo[84446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675 1073741824 Feb 27 02:02:15 devstack sudo[84446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:16 devstack sudo[84446]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675 1073741824" returned: 0 in 0.656s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:16 devstack sudo[84451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675 Feb 27 02:02:16 devstack sudo[84451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:16 devstack sudo[84451]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675" returned: 0 in 0.619s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:02:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965e08ac-0550-4b67-b6e8-22cd95735997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd2a898d-e5cc-4eab-b03b-af50f1782675', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f318c4fc-5083-4e5e-a01d-66a7431635a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:16 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Volume volume-dd2a898d-e5cc-4eab-b03b-af50f1782675 (dd2a898d-e5cc-4eab-b03b-af50f1782675): created successfully Feb 27 02:02:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f318c4fc-5083-4e5e-a01d-66a7431635a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Flow 'volume_create_manager' (1777510a-74f5-4e82-ba62-f3f5e8cc6aca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:16 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-087cb574-3075-4d23-bc88-58962a85d336 tempest-GroupSnapshotsV319Test-881419278 None] Created volume successfully. Feb 27 02:02:18 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] GroupSnapshot 72de1768-f2c7-491f-a4fd-98bc88a015c2: creating. Feb 27 02:02:18 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] Group snapshot 72de1768-f2c7-491f-a4fd-98bc88a015c2: creating. {{(pid=83231) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:02:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] Creating offline snapshot b43e6ee1-1393-43f2-a1c8-40257869f61d of volume dd2a898d-e5cc-4eab-b03b-af50f1782675 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:02:18 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5464a2-5d7c-45f4-a150-871b1a99f3bc]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:18 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] Acquiring lock "cinder-9eaefda5-3d0e-4598-8437-f0749bbe4ab9-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:18 devstack sudo[84503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675 Feb 27 02:02:18 devstack sudo[84503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:18 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] Lock "cinder-9eaefda5-3d0e-4598-8437-f0749bbe4ab9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:18 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] Acquiring lock "cinder-quobyte-9eaefda5-3d0e-4598-8437-f0749bbe4ab9" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:18 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] Lock "cinder-quobyte-9eaefda5-3d0e-4598-8437-f0749bbe4ab9" acquired by "delete_volume" :: waited 0.024s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:18 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e976795-d5ea-494e-9f80-1d966521f2fa]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:18 devstack sudo[84507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9 Feb 27 02:02:18 devstack sudo[84507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:19 devstack sudo[84503]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675" returned: 0 in 0.744s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:19 devstack sudo[84515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d 1G Feb 27 02:02:19 devstack sudo[84515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:19 devstack sudo[84507]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9" returned: 0 in 0.628s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:19 devstack sudo[84518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9 Feb 27 02:02:19 devstack sudo[84518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:19 devstack sudo[84515]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d 1G" returned: 0 in 0.674s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd2a898d-e5cc-4eab-b03b-af50f1782675 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:19 devstack sudo[84518]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9eaefda5-3d0e-4598-8437-f0749bbe4ab9" returned: 0 in 0.560s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:19 devstack sudo[84524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd2a898d-e5cc-4eab-b03b-af50f1782675 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d Feb 27 02:02:19 devstack sudo[84524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:19 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] Lock "cinder-quobyte-9eaefda5-3d0e-4598-8437-f0749bbe4ab9" released by "delete_volume" :: held 1.237s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:19 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] Created reservations ['ea0c897e-54b9-4a79-8050-7b9b3af5489d', '72f2cd9a-31ef-4821-95e4-c14cf6c89e08', '743b1791-4730-419b-acd3-63cd0e4737c3', '1a28a58e-0d25-4a6f-8ce1-2c9cf5da9e1f'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:19 devstack sudo[84526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:02:19 devstack sudo[84526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:20 devstack sudo[84524]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd2a898d-e5cc-4eab-b03b-af50f1782675 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d" returned: 0 in 0.795s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:20 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:02:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:20 devstack sudo[84533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d Feb 27 02:02:20 devstack sudo[84533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:20 devstack sudo[84526]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.711s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:20 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:20 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] Deleted volume successfully. Feb 27 02:02:20 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-880b015a-1e6d-4be6-a42b-bc9db11407c6 tempest-DeleteServersTestJSON-1093011018 None] Lock "cinder-9eaefda5-3d0e-4598-8437-f0749bbe4ab9-delete_volume" released by "delete_volume" :: held 2.161s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:21 devstack sudo[84533]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d" returned: 0 in 0.636s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:21 devstack sudo[84536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.info Feb 27 02:02:21 devstack sudo[84536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:21 devstack sudo[84536]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.info" returned: 0 in 0.676s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:21 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:02:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:21 devstack sudo[84553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.info Feb 27 02:02:21 devstack sudo[84553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:22 devstack sudo[84553]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.info" returned: 0 in 0.534s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.146s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:22 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-4d128287-eebe-4ffb-8bd2-020e8bce093e tempest-GroupSnapshotsV319Test-881419278 None] group_snapshot 72de1768-f2c7-491f-a4fd-98bc88a015c2: created successfully Feb 27 02:02:23 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] group_snapshot 72de1768-f2c7-491f-a4fd-98bc88a015c2: deleting Feb 27 02:02:23 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] group_snapshot 72de1768-f2c7-491f-a4fd-98bc88a015c2: deleting {{(pid=83231) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:02:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] Acquiring lock "cinder-quobyte-dd2a898d-e5cc-4eab-b03b-af50f1782675" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] Lock "cinder-quobyte-dd2a898d-e5cc-4eab-b03b-af50f1782675" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] Acquiring lock "cinder-quobyte-b43e6ee1-1393-43f2-a1c8-40257869f61d" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] Lock "cinder-quobyte-b43e6ee1-1393-43f2-a1c8-40257869f61d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] Deleting offline snapshot b43e6ee1-1393-43f2-a1c8-40257869f61d of volume dd2a898d-e5cc-4eab-b03b-af50f1782675 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:02:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] snapshot_file for this snap is: volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:02:23 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c34350-7239-4bd0-8034-36f7dbb8a64a]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:24 devstack sudo[84561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d Feb 27 02:02:24 devstack sudo[84561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:24 devstack sudo[84561]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d" returned: 0 in 0.761s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:24 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd2a898d-e5cc-4eab-b03b-af50f1782675(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:02:24 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ee0a14-aad7-402e-aacf-2ef505a90422]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:24 devstack sudo[84569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675 Feb 27 02:02:24 devstack sudo[84569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:25 devstack sudo[84569]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675" returned: 0 in 0.750s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:25 devstack sudo[84574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d Feb 27 02:02:25 devstack sudo[84574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:26 devstack sudo[84574]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d" returned: 0 in 0.746s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:26 devstack sudo[84607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d Feb 27 02:02:26 devstack sudo[84607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:26 devstack sudo[84607]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675.b43e6ee1-1393-43f2-a1c8-40257869f61d" returned: 0 in 0.734s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] Lock "cinder-quobyte-b43e6ee1-1393-43f2-a1c8-40257869f61d" released by "_delete_snapshot" :: held 3.065s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] Lock "cinder-quobyte-dd2a898d-e5cc-4eab-b03b-af50f1782675" released by "delete_snapshot" :: held 3.080s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:27 devstack cinder-volume[83231]: WARNING cinder.quota [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1918392926 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1918392926, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:02:27 devstack cinder-volume[83231]: WARNING cinder.quota [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1918392926 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1918392926, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:02:27 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] Created reservations ['da5492f0-ceeb-4230-b07b-2d05cd9191ed', '9a384625-387e-4f1a-90a6-683cf73fdbf2', '167d5dc3-05ca-4859-a4cd-e71116132151', '3d941080-617e-45ed-986d-0ddc9cc39dd4'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:27 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-78116c19-c0c3-45f1-8250-78bc9ebd77d4 tempest-GroupSnapshotsV319Test-881419278 None] group_snapshot 72de1768-f2c7-491f-a4fd-98bc88a015c2: deleted successfully Feb 27 02:02:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a130ed2d-b4e3-44d5-87d1-813a53c94cee tempest-GroupSnapshotsV319Test-881419278 None] Acquiring lock "cinder-quobyte-dd2a898d-e5cc-4eab-b03b-af50f1782675" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a130ed2d-b4e3-44d5-87d1-813a53c94cee tempest-GroupSnapshotsV319Test-881419278 None] Lock "cinder-quobyte-dd2a898d-e5cc-4eab-b03b-af50f1782675" acquired by "delete_volume" :: waited 0.036s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:28 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ecfab4-7341-4c9f-84bf-466a9caf5031]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a130ed2d-b4e3-44d5-87d1-813a53c94cee tempest-GroupSnapshotsV319Test-881419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:28 devstack sudo[84635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675 Feb 27 02:02:28 devstack sudo[84635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:29 devstack sudo[84635]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a130ed2d-b4e3-44d5-87d1-813a53c94cee tempest-GroupSnapshotsV319Test-881419278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675" returned: 0 in 1.115s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a130ed2d-b4e3-44d5-87d1-813a53c94cee tempest-GroupSnapshotsV319Test-881419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:29 devstack sudo[84642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675 Feb 27 02:02:29 devstack sudo[84642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:29 devstack sudo[84642]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a130ed2d-b4e3-44d5-87d1-813a53c94cee tempest-GroupSnapshotsV319Test-881419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-dd2a898d-e5cc-4eab-b03b-af50f1782675" returned: 0 in 0.573s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a130ed2d-b4e3-44d5-87d1-813a53c94cee tempest-GroupSnapshotsV319Test-881419278 None] Lock "cinder-quobyte-dd2a898d-e5cc-4eab-b03b-af50f1782675" released by "delete_volume" :: held 1.883s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:30 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-a130ed2d-b4e3-44d5-87d1-813a53c94cee tempest-GroupSnapshotsV319Test-881419278 None] Created reservations ['d15c9a46-4cdc-4b8c-81b8-f5cfbf99bd46'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:30 devstack cinder-volume[83231]: WARNING cinder.quota [None req-a130ed2d-b4e3-44d5-87d1-813a53c94cee tempest-GroupSnapshotsV319Test-881419278 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1918392926 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1918392926, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:02:30 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-a130ed2d-b4e3-44d5-87d1-813a53c94cee tempest-GroupSnapshotsV319Test-881419278 None] Created reservations ['e0827c88-0012-43da-8046-1e629ee6820a', 'a448e531-6684-45aa-b608-4eb8c065dafb', '6ca0bb1d-4755-4a64-ac16-147308263520', 'f36c2f3a-0195-40fd-930a-37688bafc01f'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a130ed2d-b4e3-44d5-87d1-813a53c94cee tempest-GroupSnapshotsV319Test-881419278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a130ed2d-b4e3-44d5-87d1-813a53c94cee tempest-GroupSnapshotsV319Test-881419278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-a130ed2d-b4e3-44d5-87d1-813a53c94cee tempest-GroupSnapshotsV319Test-881419278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-a130ed2d-b4e3-44d5-87d1-813a53c94cee tempest-GroupSnapshotsV319Test-881419278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a130ed2d-b4e3-44d5-87d1-813a53c94cee tempest-GroupSnapshotsV319Test-881419278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a130ed2d-b4e3-44d5-87d1-813a53c94cee tempest-GroupSnapshotsV319Test-881419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:30 devstack sudo[84645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:02:30 devstack sudo[84645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:31 devstack sudo[84645]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a130ed2d-b4e3-44d5-87d1-813a53c94cee tempest-GroupSnapshotsV319Test-881419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.921s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:31 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-a130ed2d-b4e3-44d5-87d1-813a53c94cee tempest-GroupSnapshotsV319Test-881419278 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:31 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-a130ed2d-b4e3-44d5-87d1-813a53c94cee tempest-GroupSnapshotsV319Test-881419278 None] Delete group completed successfully. Feb 27 02:02:40 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=33,cinder:UPDATE=35,cinder:INSERT=2 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:02:40 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=30,cinder:INSERT=13,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:02:43 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-717f2fc5-746c-40f3-92fa-4300acd1643b tempest-GroupsV320Test-188879417 None] Group tempest-GroupsV320Test-Group-1436155917: creating Feb 27 02:02:43 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-717f2fc5-746c-40f3-92fa-4300acd1643b tempest-GroupsV320Test-188879417 None] Group tempest-GroupsV320Test-Group-1436155917: created successfully Feb 27 02:02:43 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-717f2fc5-746c-40f3-92fa-4300acd1643b tempest-GroupsV320Test-188879417 None] Create group completed successfully. Feb 27 02:02:45 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-1fd56e01-e3cf-4a9a-ac1e-4f7bb3c87785 tempest-GroupsV320Test-188879417 None] Created reservations ['fffa326b-10a7-419c-839a-413f6caee213'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1fd56e01-e3cf-4a9a-ac1e-4f7bb3c87785 tempest-GroupsV320Test-188879417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1fd56e01-e3cf-4a9a-ac1e-4f7bb3c87785 tempest-GroupsV320Test-188879417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1fd56e01-e3cf-4a9a-ac1e-4f7bb3c87785 tempest-GroupsV320Test-188879417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1fd56e01-e3cf-4a9a-ac1e-4f7bb3c87785 tempest-GroupsV320Test-188879417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1fd56e01-e3cf-4a9a-ac1e-4f7bb3c87785 tempest-GroupsV320Test-188879417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1fd56e01-e3cf-4a9a-ac1e-4f7bb3c87785 tempest-GroupsV320Test-188879417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:45 devstack sudo[84655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:02:45 devstack sudo[84655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:46 devstack sudo[84655]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1fd56e01-e3cf-4a9a-ac1e-4f7bb3c87785 tempest-GroupsV320Test-188879417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.744s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:46 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-1fd56e01-e3cf-4a9a-ac1e-4f7bb3c87785 tempest-GroupsV320Test-188879417 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:46 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-1fd56e01-e3cf-4a9a-ac1e-4f7bb3c87785 tempest-GroupsV320Test-188879417 None] Delete group completed successfully. Feb 27 02:02:47 devstack cinder-volume[83231]: DEBUG oslo_service.periodic_task [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83231) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:02:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:47 devstack sudo[84691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:02:47 devstack sudo[84691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:47 devstack sudo[84691]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.616s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:47 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Flow 'volume_create_manager' (14e3f632-c919-4df6-bc08-854e2fc62bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b603185-d41b-4833-96c6-4941a3a88714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b603185-d41b-4833-96c6-4941a3a88714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-650533439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=074b91cd-5f01-4ba2-8fd0-a0d920683292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d31b97a76342fc8132b833473c5c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:53Z,use_quota=True,user_id='5facc272a5c94826b7a88cbbc74451df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (427780ac-75bc-4ba9-90a5-e779b0d73c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (427780ac-75bc-4ba9-90a5-e779b0d73c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f339ef27-6274-438f-98e8-aaa9dff18b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f339ef27-6274-438f-98e8-aaa9dff18b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '074b91cd-5f01-4ba2-8fd0-a0d920683292', 'volume_name': 'volume-074b91cd-5f01-4ba2-8fd0-a0d920683292', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090cfbda-41c0-4640-8478-1d3c22385e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090cfbda-41c0-4640-8478-1d3c22385e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952a4c6c-1b37-42fd-a94c-3f4180aaab26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:53 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Volume 074b91cd-5f01-4ba2-8fd0-a0d920683292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-074b91cd-5f01-4ba2-8fd0-a0d920683292', 'volume_size': 1} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-650533439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=074b91cd-5f01-4ba2-8fd0-a0d920683292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d31b97a76342fc8132b833473c5c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:53Z,use_quota=True,user_id='5facc272a5c94826b7a88cbbc74451df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Creating volume 074b91cd-5f01-4ba2-8fd0-a0d920683292 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:02:53 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:02:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:53 devstack sudo[84779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292 1073741824 Feb 27 02:02:53 devstack sudo[84779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:55 devstack sudo[84779]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292 1073741824" returned: 0 in 2.054s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:55 devstack sudo[84801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292 Feb 27 02:02:55 devstack sudo[84801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:56 devstack sudo[84801]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292" returned: 0 in 1.197s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:56 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] <== create_volume: return (3364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:02:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.386s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:56 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:02:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Flow 'volume_create_manager' (dd727fdf-1676-4196-ace6-6a7a1411aab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d01af0-e399-487f-be91-30adcfd9a8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952a4c6c-1b37-42fd-a94c-3f4180aaab26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-074b91cd-5f01-4ba2-8fd0-a0d920683292', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ca3b57-cafe-4351-b4ec-968fc3df2e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d01af0-e399-487f-be91-30adcfd9a8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1593203118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c53bc2-82ff-4032-bdcd-f2cc7016ab26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2607118545af4823b63f0be2a6957f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:57Z,use_quota=True,user_id='4533450392494dafada74dfc07a5142e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0ad196-8678-47be-9a3c-7aff7c8fffc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0ad196-8678-47be-9a3c-7aff7c8fffc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:57 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58a2fab-5650-4d1a-95f8-4048725b70b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:57 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58a2fab-5650-4d1a-95f8-4048725b70b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c53bc2-82ff-4032-bdcd-f2cc7016ab26', 'volume_name': 'volume-74c53bc2-82ff-4032-bdcd-f2cc7016ab26', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:57 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba5c7de-a1bd-4c52-939d-b0d582bc03a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:57 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba5c7de-a1bd-4c52-939d-b0d582bc03a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:57 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b925e7-ab08-4c31-86dc-f7bd0caedf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:57 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Volume 74c53bc2-82ff-4032-bdcd-f2cc7016ab26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c53bc2-82ff-4032-bdcd-f2cc7016ab26', 'volume_size': 1} Feb 27 02:02:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:57 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1593203118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c53bc2-82ff-4032-bdcd-f2cc7016ab26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2607118545af4823b63f0be2a6957f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:57Z,use_quota=True,user_id='4533450392494dafada74dfc07a5142e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:02:57 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Creating volume 74c53bc2-82ff-4032-bdcd-f2cc7016ab26 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:02:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:57 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:57 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:57 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:02:57 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:02:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-74c53bc2-82ff-4032-bdcd-f2cc7016ab26 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:57 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Volume volume-074b91cd-5f01-4ba2-8fd0-a0d920683292 (074b91cd-5f01-4ba2-8fd0-a0d920683292): created successfully Feb 27 02:02:57 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ca3b57-cafe-4351-b4ec-968fc3df2e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:57 devstack sudo[84805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-74c53bc2-82ff-4032-bdcd-f2cc7016ab26 1073741824 Feb 27 02:02:57 devstack sudo[84805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:57 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Flow 'volume_create_manager' (14e3f632-c919-4df6-bc08-854e2fc62bd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:57 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-6ffc5597-28b0-45de-83a3-e3bc9e9f9456 tempest-SnapshotsActionsTest-88137101 None] Created volume successfully. Feb 27 02:02:58 devstack sudo[84805]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-74c53bc2-82ff-4032-bdcd-f2cc7016ab26 1073741824" returned: 0 in 0.973s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-74c53bc2-82ff-4032-bdcd-f2cc7016ab26 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:58 devstack sudo[84815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-74c53bc2-82ff-4032-bdcd-f2cc7016ab26 Feb 27 02:02:58 devstack sudo[84815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0cd3eb84-765a-41c9-90be-65fdcf70ad95 tempest-SnapshotsActionsTest-88137101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:58 devstack sudo[84815]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-74c53bc2-82ff-4032-bdcd-f2cc7016ab26" returned: 0 in 0.635s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:02:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0cd3eb84-765a-41c9-90be-65fdcf70ad95 tempest-SnapshotsActionsTest-88137101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.273s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-0cd3eb84-765a-41c9-90be-65fdcf70ad95 tempest-SnapshotsActionsTest-88137101 None] Creating offline snapshot b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 of volume 074b91cd-5f01-4ba2-8fd0-a0d920683292 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:02:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b925e7-ab08-4c31-86dc-f7bd0caedf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c53bc2-82ff-4032-bdcd-f2cc7016ab26', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c297ff0-2a95-41fa-8571-8a9a61b33fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:58 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8288f886-93d4-4eb2-a28f-3208a5c2a560]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0cd3eb84-765a-41c9-90be-65fdcf70ad95 tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:58 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Volume volume-74c53bc2-82ff-4032-bdcd-f2cc7016ab26 (74c53bc2-82ff-4032-bdcd-f2cc7016ab26): created successfully Feb 27 02:02:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c297ff0-2a95-41fa-8571-8a9a61b33fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Flow 'volume_create_manager' (dd727fdf-1676-4196-ace6-6a7a1411aab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:58 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-a94e455c-33ed-4666-ac72-ad71a6e86693 tempest-ServerRescueNegativeTestJSON-866425012 None] Created volume successfully. Feb 27 02:02:58 devstack sudo[84818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292 Feb 27 02:02:58 devstack sudo[84818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:59 devstack sudo[84818]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0cd3eb84-765a-41c9-90be-65fdcf70ad95 tempest-SnapshotsActionsTest-88137101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292" returned: 0 in 1.143s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0cd3eb84-765a-41c9-90be-65fdcf70ad95 tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:59 devstack sudo[84853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 1G Feb 27 02:02:59 devstack sudo[84853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:01 devstack sudo[84853]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0cd3eb84-765a-41c9-90be-65fdcf70ad95 tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 1G" returned: 0 in 1.814s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0cd3eb84-765a-41c9-90be-65fdcf70ad95 tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074b91cd-5f01-4ba2-8fd0-a0d920683292 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:01 devstack sudo[84863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074b91cd-5f01-4ba2-8fd0-a0d920683292 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 Feb 27 02:03:01 devstack sudo[84863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:03 devstack sudo[84863]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0cd3eb84-765a-41c9-90be-65fdcf70ad95 tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074b91cd-5f01-4ba2-8fd0-a0d920683292 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0" returned: 0 in 1.591s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:03 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-0cd3eb84-765a-41c9-90be-65fdcf70ad95 tempest-SnapshotsActionsTest-88137101 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 is being set with open permissions: ugo+rw Feb 27 02:03:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0cd3eb84-765a-41c9-90be-65fdcf70ad95 tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:03 devstack sudo[84893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 Feb 27 02:03:03 devstack sudo[84893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:04 devstack sudo[84893]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0cd3eb84-765a-41c9-90be-65fdcf70ad95 tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0" returned: 0 in 0.898s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0cd3eb84-765a-41c9-90be-65fdcf70ad95 tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:04 devstack sudo[84897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.info Feb 27 02:03:04 devstack sudo[84897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:05 devstack sudo[84897]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0cd3eb84-765a-41c9-90be-65fdcf70ad95 tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.info" returned: 0 in 1.067s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:05 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-0cd3eb84-765a-41c9-90be-65fdcf70ad95 tempest-SnapshotsActionsTest-88137101 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.info is being set with open permissions: ugo+rw Feb 27 02:03:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0cd3eb84-765a-41c9-90be-65fdcf70ad95 tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:05 devstack sudo[84926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.info Feb 27 02:03:05 devstack sudo[84926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:06 devstack sudo[84926]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0cd3eb84-765a-41c9-90be-65fdcf70ad95 tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.info" returned: 0 in 0.780s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0cd3eb84-765a-41c9-90be-65fdcf70ad95 tempest-SnapshotsActionsTest-88137101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.510s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:06 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-0cd3eb84-765a-41c9-90be-65fdcf70ad95 tempest-SnapshotsActionsTest-88137101 None] Create snapshot completed successfully Feb 27 02:03:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ea9f455e-1089-45cc-a64d-fe89c96eed9b tempest-SnapshotsActionsTest-88137101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ea9f455e-1089-45cc-a64d-fe89c96eed9b tempest-SnapshotsActionsTest-88137101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:08 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-ea9f455e-1089-45cc-a64d-fe89c96eed9b tempest-SnapshotsActionsTest-88137101 None] Creating offline snapshot 1326385e-fa29-40d6-b951-b413ac42cf24 of volume 074b91cd-5f01-4ba2-8fd0-a0d920683292 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:03:08 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[2635529a-20e2-453a-af5f-104e4d973e46]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ea9f455e-1089-45cc-a64d-fe89c96eed9b tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:08 devstack sudo[84940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 Feb 27 02:03:08 devstack sudo[84940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:09 devstack sudo[84940]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ea9f455e-1089-45cc-a64d-fe89c96eed9b tempest-SnapshotsActionsTest-88137101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0" returned: 0 in 0.988s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:09 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-ea9f455e-1089-45cc-a64d-fe89c96eed9b tempest-SnapshotsActionsTest-88137101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074b91cd-5f01-4ba2-8fd0-a0d920683292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ea9f455e-1089-45cc-a64d-fe89c96eed9b tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:09 devstack sudo[84945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24 1G Feb 27 02:03:09 devstack sudo[84945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:11 devstack sudo[84945]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ea9f455e-1089-45cc-a64d-fe89c96eed9b tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24 1G" returned: 0 in 1.833s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ea9f455e-1089-45cc-a64d-fe89c96eed9b tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:11 devstack sudo[84978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24 Feb 27 02:03:11 devstack sudo[84978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:12 devstack sudo[84978]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ea9f455e-1089-45cc-a64d-fe89c96eed9b tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24" returned: 0 in 1.706s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:12 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-ea9f455e-1089-45cc-a64d-fe89c96eed9b tempest-SnapshotsActionsTest-88137101 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24 is being set with open permissions: ugo+rw Feb 27 02:03:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ea9f455e-1089-45cc-a64d-fe89c96eed9b tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:12 devstack sudo[84990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24 Feb 27 02:03:12 devstack sudo[84990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:14 devstack sudo[84990]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ea9f455e-1089-45cc-a64d-fe89c96eed9b tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24" returned: 0 in 1.364s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ea9f455e-1089-45cc-a64d-fe89c96eed9b tempest-SnapshotsActionsTest-88137101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.058s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:14 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-ea9f455e-1089-45cc-a64d-fe89c96eed9b tempest-SnapshotsActionsTest-88137101 None] Create snapshot completed successfully Feb 27 02:03:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] Acquiring lock "cinder-1326385e-fa29-40d6-b951-b413ac42cf24-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-1326385e-fa29-40d6-b951-b413ac42cf24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] Acquiring lock "cinder-quobyte-074b91cd-5f01-4ba2-8fd0-a0d920683292" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:15 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-quobyte-074b91cd-5f01-4ba2-8fd0-a0d920683292" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:15 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] Acquiring lock "cinder-quobyte-1326385e-fa29-40d6-b951-b413ac42cf24" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:15 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-quobyte-1326385e-fa29-40d6-b951-b413ac42cf24" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] Deleting offline snapshot 1326385e-fa29-40d6-b951-b413ac42cf24 of volume 074b91cd-5f01-4ba2-8fd0-a0d920683292 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:03:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] snapshot_file for this snap is: volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:03:15 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d942650d-ca99-41f0-bd65-2ee5e48d7403]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:15 devstack sudo[85018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24 Feb 27 02:03:15 devstack sudo[85018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:16 devstack sudo[85018]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24" returned: 0 in 0.924s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074b91cd-5f01-4ba2-8fd0-a0d920683292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:16 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[10119ba5-4d98-46c5-8a91-117cf3d569c6]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:16 devstack sudo[85067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 Feb 27 02:03:16 devstack sudo[85067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:18 devstack sudo[85067]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0" returned: 0 in 2.480s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074b91cd-5f01-4ba2-8fd0-a0d920683292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:18 devstack sudo[85134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24 Feb 27 02:03:18 devstack sudo[85134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:20 devstack sudo[85134]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24" returned: 0 in 1.994s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:20 devstack sudo[85165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24 Feb 27 02:03:20 devstack sudo[85165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:21 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] Acquiring lock "cinder-74c53bc2-82ff-4032-bdcd-f2cc7016ab26-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:21 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] Lock "cinder-74c53bc2-82ff-4032-bdcd-f2cc7016ab26-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:21 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] Acquiring lock "cinder-quobyte-74c53bc2-82ff-4032-bdcd-f2cc7016ab26" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:21 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] Lock "cinder-quobyte-74c53bc2-82ff-4032-bdcd-f2cc7016ab26" acquired by "delete_volume" :: waited 0.038s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:21 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcd6702-1c61-4534-81c9-da88ea1b289b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-74c53bc2-82ff-4032-bdcd-f2cc7016ab26 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:21 devstack sudo[85167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-74c53bc2-82ff-4032-bdcd-f2cc7016ab26 Feb 27 02:03:21 devstack sudo[85167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:22 devstack sudo[85165]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.1326385e-fa29-40d6-b951-b413ac42cf24" returned: 0 in 1.330s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-quobyte-1326385e-fa29-40d6-b951-b413ac42cf24" released by "_delete_snapshot" :: held 7.004s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-quobyte-074b91cd-5f01-4ba2-8fd0-a0d920683292" released by "delete_snapshot" :: held 7.026s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:22 devstack cinder-volume[83231]: WARNING cinder.quota [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:22 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] Created reservations ['d5152ee4-cf46-4edd-88ef-f215484c4506', '1fd480fb-6051-4542-be19-654ced7f26a0', '2d00fc46-2876-44e9-998b-aabb6240c9bc', '86c0f94f-1193-4ace-bfd7-6c39c459a6cb'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:22 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] Delete snapshot completed successfully. Feb 27 02:03:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-aae35786-b0f6-484d-91fb-8689391e3763 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-1326385e-fa29-40d6-b951-b413ac42cf24-delete_snapshot" released by "delete_snapshot" :: held 7.339s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:22 devstack sudo[85167]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-74c53bc2-82ff-4032-bdcd-f2cc7016ab26" returned: 0 in 1.408s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-74c53bc2-82ff-4032-bdcd-f2cc7016ab26 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:22 devstack sudo[85175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-74c53bc2-82ff-4032-bdcd-f2cc7016ab26 Feb 27 02:03:22 devstack sudo[85175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f15e46d2-8b1a-4e09-aae5-2713d6de3cf3 tempest-SnapshotsActionsTest-88137101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f15e46d2-8b1a-4e09-aae5-2713d6de3cf3 tempest-SnapshotsActionsTest-88137101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-f15e46d2-8b1a-4e09-aae5-2713d6de3cf3 tempest-SnapshotsActionsTest-88137101 None] Creating offline snapshot 63be45e7-608f-4296-a0d1-ce69b36d09b3 of volume 074b91cd-5f01-4ba2-8fd0-a0d920683292 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:03:23 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ade562-e968-4610-b5d2-0f61575a1930]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f15e46d2-8b1a-4e09-aae5-2713d6de3cf3 tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:23 devstack sudo[85178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 Feb 27 02:03:23 devstack sudo[85178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:23 devstack sudo[85175]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-74c53bc2-82ff-4032-bdcd-f2cc7016ab26" returned: 0 in 1.048s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] Lock "cinder-quobyte-74c53bc2-82ff-4032-bdcd-f2cc7016ab26" released by "delete_volume" :: held 2.574s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:24 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] Created reservations ['634601e7-d926-4c87-b5b4-e6ab16d54952', '2d48e354-59b2-4dd8-aaa6-2b31c619319f', '4d13c425-2102-4bcc-8f1c-d2743fe9af06', '05e70c75-0110-456c-8a90-1b212c841ac8'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:24 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:24 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:24 devstack sudo[85180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:03:24 devstack sudo[85180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:25 devstack sudo[85178]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f15e46d2-8b1a-4e09-aae5-2713d6de3cf3 tempest-SnapshotsActionsTest-88137101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0" returned: 0 in 1.908s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:25 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-f15e46d2-8b1a-4e09-aae5-2713d6de3cf3 tempest-SnapshotsActionsTest-88137101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074b91cd-5f01-4ba2-8fd0-a0d920683292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f15e46d2-8b1a-4e09-aae5-2713d6de3cf3 tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:25 devstack sudo[85197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3 1G Feb 27 02:03:25 devstack sudo[85197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:26 devstack sudo[85180]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 2.309s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:26 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:26 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] Deleted volume successfully. Feb 27 02:03:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-01fa3304-eb65-4847-8cd3-382b096084fc tempest-ServerRescueNegativeTestJSON-866425012 None] Lock "cinder-74c53bc2-82ff-4032-bdcd-f2cc7016ab26-delete_volume" released by "delete_volume" :: held 5.460s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:28 devstack sudo[85197]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f15e46d2-8b1a-4e09-aae5-2713d6de3cf3 tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3 1G" returned: 0 in 3.141s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f15e46d2-8b1a-4e09-aae5-2713d6de3cf3 tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:28 devstack sudo[85254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3 Feb 27 02:03:28 devstack sudo[85254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:30 devstack sudo[85254]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f15e46d2-8b1a-4e09-aae5-2713d6de3cf3 tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3" returned: 0 in 1.426s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:30 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-f15e46d2-8b1a-4e09-aae5-2713d6de3cf3 tempest-SnapshotsActionsTest-88137101 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3 is being set with open permissions: ugo+rw Feb 27 02:03:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f15e46d2-8b1a-4e09-aae5-2713d6de3cf3 tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:30 devstack sudo[85260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3 Feb 27 02:03:30 devstack sudo[85260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:30 devstack sudo[85260]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f15e46d2-8b1a-4e09-aae5-2713d6de3cf3 tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3" returned: 0 in 0.748s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f15e46d2-8b1a-4e09-aae5-2713d6de3cf3 tempest-SnapshotsActionsTest-88137101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.564s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:31 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-f15e46d2-8b1a-4e09-aae5-2713d6de3cf3 tempest-SnapshotsActionsTest-88137101 None] Create snapshot completed successfully Feb 27 02:03:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] Acquiring lock "cinder-63be45e7-608f-4296-a0d1-ce69b36d09b3-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-63be45e7-608f-4296-a0d1-ce69b36d09b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] Acquiring lock "cinder-quobyte-074b91cd-5f01-4ba2-8fd0-a0d920683292" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-quobyte-074b91cd-5f01-4ba2-8fd0-a0d920683292" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] Acquiring lock "cinder-quobyte-63be45e7-608f-4296-a0d1-ce69b36d09b3" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-quobyte-63be45e7-608f-4296-a0d1-ce69b36d09b3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:31 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] Deleting offline snapshot 63be45e7-608f-4296-a0d1-ce69b36d09b3 of volume 074b91cd-5f01-4ba2-8fd0-a0d920683292 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:03:31 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] snapshot_file for this snap is: volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:03:31 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dac3b6-7a10-4c9f-aef8-67f94c790635]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:31 devstack sudo[85263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3 Feb 27 02:03:31 devstack sudo[85263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Flow 'volume_create_manager' (12dbe006-4d6b-4a0c-82c4-174dd4be5954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2358529c-f10b-47e3-930a-c72d9db437a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2358529c-f10b-47e3-930a-c72d9db437a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:32Z,deleted=False,deleted_at=None,display_description='',display_name='64f7bf20-048b-43da-9901-2342bec7ec54-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdca9f0f-d22e-4144-bd97-829cd47b649d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452ffa5eda324e439dd81cfbbb6625b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:33Z,use_quota=True,user_id='1414300d454a4d4e8c20ee14fdb6138f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ef3a74-44c8-4321-8ba8-e8994d6d383f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ef3a74-44c8-4321-8ba8-e8994d6d383f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb43192-7856-4205-862f-74730a2736ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb43192-7856-4205-862f-74730a2736ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdca9f0f-d22e-4144-bd97-829cd47b649d', 'volume_name': 'volume-fdca9f0f-d22e-4144-bd97-829cd47b649d', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21304875-f1e0-4dc7-8c1e-9f18a7043837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21304875-f1e0-4dc7-8c1e-9f18a7043837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11bd3519-24fe-41dc-b291-b6befbc766c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:32 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Volume fdca9f0f-d22e-4144-bd97-829cd47b649d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdca9f0f-d22e-4144-bd97-829cd47b649d', 'volume_size': 1} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:32Z,deleted=False,deleted_at=None,display_description='',display_name='64f7bf20-048b-43da-9901-2342bec7ec54-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdca9f0f-d22e-4144-bd97-829cd47b649d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452ffa5eda324e439dd81cfbbb6625b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:33Z,use_quota=True,user_id='1414300d454a4d4e8c20ee14fdb6138f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Creating volume fdca9f0f-d22e-4144-bd97-829cd47b649d {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:32 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:03:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fdca9f0f-d22e-4144-bd97-829cd47b649d 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:32 devstack sudo[85269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fdca9f0f-d22e-4144-bd97-829cd47b649d 1073741824 Feb 27 02:03:32 devstack sudo[85269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:33 devstack sudo[85263]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3" returned: 0 in 1.797s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:33 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074b91cd-5f01-4ba2-8fd0-a0d920683292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:33 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a419e8-3c7c-4181-bdfd-731fedbddd11]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:33 devstack sudo[85272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 Feb 27 02:03:33 devstack sudo[85272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:34 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Flow 'volume_create_manager' (7dc8bcdb-7dd0-4f68-bf41-2379680ce8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2fe2d85-f338-4674-94e7-7e21293f0e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2fe2d85-f338-4674-94e7-7e21293f0e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-103246062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=076487d3-51c8-4cb3-a06f-ad45689ef0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8744ed910d2d464bb0a8d7754dcdacbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:34Z,use_quota=True,user_id='c9883e14e52f44e7bb0cd4b1be21c810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02a1245-64d5-4746-949e-b1394dbf3976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02a1245-64d5-4746-949e-b1394dbf3976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb30a4c6-c650-45ee-9815-813eb46f38a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb30a4c6-c650-45ee-9815-813eb46f38a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '076487d3-51c8-4cb3-a06f-ad45689ef0aa', 'volume_name': 'volume-076487d3-51c8-4cb3-a06f-ad45689ef0aa', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a884d89-1f9d-4b36-a433-152cc1071457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a884d89-1f9d-4b36-a433-152cc1071457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a90cc4-be76-478f-a3fb-1a6d2db81876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:34 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Volume 076487d3-51c8-4cb3-a06f-ad45689ef0aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-076487d3-51c8-4cb3-a06f-ad45689ef0aa', 'volume_size': 1} Feb 27 02:03:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:35 devstack sudo[85272]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0" returned: 0 in 1.619s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074b91cd-5f01-4ba2-8fd0-a0d920683292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:35 devstack sudo[85282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3 Feb 27 02:03:35 devstack sudo[85282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:35 devstack sudo[85269]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fdca9f0f-d22e-4144-bd97-829cd47b649d 1073741824" returned: 0 in 2.426s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fdca9f0f-d22e-4144-bd97-829cd47b649d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:35 devstack sudo[85290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fdca9f0f-d22e-4144-bd97-829cd47b649d Feb 27 02:03:35 devstack sudo[85290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:36 devstack sudo[85282]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3" returned: 0 in 1.198s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:36 devstack sudo[85318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3 Feb 27 02:03:36 devstack sudo[85318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:36 devstack sudo[85290]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fdca9f0f-d22e-4144-bd97-829cd47b649d" returned: 0 in 1.361s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:36 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] <== create_volume: return (3895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.904s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.314s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:36 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-103246062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=076487d3-51c8-4cb3-a06f-ad45689ef0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8744ed910d2d464bb0a8d7754dcdacbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:34Z,use_quota=True,user_id='c9883e14e52f44e7bb0cd4b1be21c810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:36 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Creating volume 076487d3-51c8-4cb3-a06f-ad45689ef0aa {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:36 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:36 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:36 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:36 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:03:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-076487d3-51c8-4cb3-a06f-ad45689ef0aa 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:36 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11bd3519-24fe-41dc-b291-b6befbc766c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdca9f0f-d22e-4144-bd97-829cd47b649d', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:36 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0416eb-2a3b-4149-aea8-9972a2f7a7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:36 devstack sudo[85322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-076487d3-51c8-4cb3-a06f-ad45689ef0aa 1073741824 Feb 27 02:03:36 devstack sudo[85322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:36 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Volume volume-fdca9f0f-d22e-4144-bd97-829cd47b649d (fdca9f0f-d22e-4144-bd97-829cd47b649d): created successfully Feb 27 02:03:36 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0416eb-2a3b-4149-aea8-9972a2f7a7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:36 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Flow 'volume_create_manager' (12dbe006-4d6b-4a0c-82c4-174dd4be5954) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:36 devstack cinder-volume[83231]: INFO cinder.volume.manager [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-8c391c2e-8c38-438a-938b-e2ae23290d0f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Created volume successfully. Feb 27 02:03:37 devstack sudo[85318]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.63be45e7-608f-4296-a0d1-ce69b36d09b3" returned: 0 in 0.988s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-quobyte-63be45e7-608f-4296-a0d1-ce69b36d09b3" released by "_delete_snapshot" :: held 5.825s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-quobyte-074b91cd-5f01-4ba2-8fd0-a0d920683292" released by "delete_snapshot" :: held 5.857s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:37 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] Created reservations ['b6d043fd-6b33-4f57-965d-8dd9a89ae30d', '7de788d4-a906-4482-abda-f08b53688e9e', 'f27a0eee-6fc1-444a-95db-9980881e6178', 'b21a8bef-6d9b-4ecd-bec9-4ad1911790ad'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:37 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] Delete snapshot completed successfully. Feb 27 02:03:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4d9b4d3b-450f-4dee-8fc7-e9aa18da8d01 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-63be45e7-608f-4296-a0d1-ce69b36d09b3-delete_snapshot" released by "delete_snapshot" :: held 6.076s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:37 devstack sudo[85322]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-076487d3-51c8-4cb3-a06f-ad45689ef0aa 1073741824" returned: 0 in 1.157s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-076487d3-51c8-4cb3-a06f-ad45689ef0aa {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:38 devstack sudo[85329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-076487d3-51c8-4cb3-a06f-ad45689ef0aa Feb 27 02:03:38 devstack sudo[85329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f0284ba9-8c6e-4f3b-9b15-75bc85690029 tempest-SnapshotsActionsTest-88137101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:38 devstack sudo[85329]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-076487d3-51c8-4cb3-a06f-ad45689ef0aa" returned: 0 in 0.672s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:38 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f0284ba9-8c6e-4f3b-9b15-75bc85690029 tempest-SnapshotsActionsTest-88137101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.233s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a90cc4-be76-478f-a3fb-1a6d2db81876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-076487d3-51c8-4cb3-a06f-ad45689ef0aa', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4bfa018-9f82-4069-93a2-3d71177642eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:38 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-f0284ba9-8c6e-4f3b-9b15-75bc85690029 tempest-SnapshotsActionsTest-88137101 None] Creating offline snapshot 8b38063b-9c8e-409e-b161-f71437692ee6 of volume 074b91cd-5f01-4ba2-8fd0-a0d920683292 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:03:38 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4826e9cc-abf1-4427-8305-25f17cce1ad4]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f0284ba9-8c6e-4f3b-9b15-75bc85690029 tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:38 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Volume volume-076487d3-51c8-4cb3-a06f-ad45689ef0aa (076487d3-51c8-4cb3-a06f-ad45689ef0aa): created successfully Feb 27 02:03:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4bfa018-9f82-4069-93a2-3d71177642eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Flow 'volume_create_manager' (7dc8bcdb-7dd0-4f68-bf41-2379680ce8a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:38 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-368201b4-99c2-455d-a4f9-98636936d91a tempest-ServersNegativeTestJSON-1540899718 None] Created volume successfully. Feb 27 02:03:38 devstack sudo[85333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 Feb 27 02:03:38 devstack sudo[85333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-4abd89a7-6161-434e-a900-897b209c31db tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:39 devstack sudo[85333]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f0284ba9-8c6e-4f3b-9b15-75bc85690029 tempest-SnapshotsActionsTest-88137101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0" returned: 0 in 0.883s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-f0284ba9-8c6e-4f3b-9b15-75bc85690029 tempest-SnapshotsActionsTest-88137101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074b91cd-5f01-4ba2-8fd0-a0d920683292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f0284ba9-8c6e-4f3b-9b15-75bc85690029 tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:39 devstack sudo[85351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6 1G Feb 27 02:03:39 devstack sudo[85351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:40 devstack sudo[85351]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f0284ba9-8c6e-4f3b-9b15-75bc85690029 tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6 1G" returned: 0 in 0.820s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f0284ba9-8c6e-4f3b-9b15-75bc85690029 tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:40 devstack sudo[85359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6 Feb 27 02:03:40 devstack sudo[85359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:40 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:UPDATE=42,cinder:SELECT=39,cinder:INSERT=11,cinder:DELETE=3 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:03:40 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=41,cinder:UPDATE=37,cinder:DELETE=5,cinder:INSERT=7 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:03:40 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Flow 'volume_create_manager' (b05fa3a7-13de-4bb3-a624-e74c5793a8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504f163a-946a-4b8f-a950-cd5f44116cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504f163a-946a-4b8f-a950-cd5f44116cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-379958790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e310f8-4d6e-430a-9f4c-2aac526246a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8744ed910d2d464bb0a8d7754dcdacbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:41Z,use_quota=True,user_id='c9883e14e52f44e7bb0cd4b1be21c810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4632f1-1f14-4cb8-a70d-befeafec26a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4632f1-1f14-4cb8-a70d-befeafec26a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01fdb12f-f395-4196-be00-4ac8d6e7ef7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01fdb12f-f395-4196-be00-4ac8d6e7ef7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e310f8-4d6e-430a-9f4c-2aac526246a5', 'volume_name': 'volume-15e310f8-4d6e-430a-9f4c-2aac526246a5', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc572e7-9096-48e2-81b2-e10124d03de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc572e7-9096-48e2-81b2-e10124d03de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66007ff4-91c2-48e1-bad4-ff95506b07bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:40 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Volume 15e310f8-4d6e-430a-9f4c-2aac526246a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e310f8-4d6e-430a-9f4c-2aac526246a5', 'volume_size': 1} Feb 27 02:03:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:41 devstack sudo[85359]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f0284ba9-8c6e-4f3b-9b15-75bc85690029 tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6" returned: 0 in 0.663s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:41 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-f0284ba9-8c6e-4f3b-9b15-75bc85690029 tempest-SnapshotsActionsTest-88137101 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6 is being set with open permissions: ugo+rw Feb 27 02:03:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f0284ba9-8c6e-4f3b-9b15-75bc85690029 tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:41 devstack sudo[85364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6 Feb 27 02:03:41 devstack sudo[85364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:41 devstack sudo[85364]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f0284ba9-8c6e-4f3b-9b15-75bc85690029 tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6" returned: 0 in 0.525s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f0284ba9-8c6e-4f3b-9b15-75bc85690029 tempest-SnapshotsActionsTest-88137101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.987s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-4abd89a7-6161-434e-a900-897b209c31db tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.421s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:41 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1fff86-0b52-4b2f-92c2-e3ec710cb95c]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-4abd89a7-6161-434e-a900-897b209c31db tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fdca9f0f-d22e-4144-bd97-829cd47b649d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:41 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-f0284ba9-8c6e-4f3b-9b15-75bc85690029 tempest-SnapshotsActionsTest-88137101 None] Create snapshot completed successfully Feb 27 02:03:41 devstack sudo[85370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fdca9f0f-d22e-4144-bd97-829cd47b649d Feb 27 02:03:41 devstack sudo[85370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] Acquiring lock "cinder-8b38063b-9c8e-409e-b161-f71437692ee6-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-8b38063b-9c8e-409e-b161-f71437692ee6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] Acquiring lock "cinder-quobyte-074b91cd-5f01-4ba2-8fd0-a0d920683292" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-quobyte-074b91cd-5f01-4ba2-8fd0-a0d920683292" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] Acquiring lock "cinder-quobyte-8b38063b-9c8e-409e-b161-f71437692ee6" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-quobyte-8b38063b-9c8e-409e-b161-f71437692ee6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] Deleting offline snapshot 8b38063b-9c8e-409e-b161-f71437692ee6 of volume 074b91cd-5f01-4ba2-8fd0-a0d920683292 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] snapshot_file for this snap is: volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[220aa7a6-b4f2-447b-99f6-7d7bdddf2112]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:42 devstack sudo[85374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6 Feb 27 02:03:42 devstack sudo[85374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:42 devstack sudo[85370]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-4abd89a7-6161-434e-a900-897b209c31db tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fdca9f0f-d22e-4144-bd97-829cd47b649d" returned: 0 in 1.041s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-4abd89a7-6161-434e-a900-897b209c31db tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.054s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.789s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-379958790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e310f8-4d6e-430a-9f4c-2aac526246a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8744ed910d2d464bb0a8d7754dcdacbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:41Z,use_quota=True,user_id='c9883e14e52f44e7bb0cd4b1be21c810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Creating volume 15e310f8-4d6e-430a-9f4c-2aac526246a5 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:42 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-15e310f8-4d6e-430a-9f4c-2aac526246a5 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:42 devstack sudo[85379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-15e310f8-4d6e-430a-9f4c-2aac526246a5 1073741824 Feb 27 02:03:42 devstack sudo[85379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-4abd89a7-6161-434e-a900-897b209c31db tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa', 'name': 'volume-fdca9f0f-d22e-4144-bd97-829cd47b649d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3193f383-f72e-4f38-8160-701e8f23be62', 'enforce_multipath': True} {{(pid=83231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 02:03:43 devstack cinder-volume[83231]: INFO cinder.volume.manager [req-08d142d5-faa5-4465-95aa-4cf8ab90cab2 req-4abd89a7-6161-434e-a900-897b209c31db tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] attachment_update completed successfully. Feb 27 02:03:43 devstack sudo[85374]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6" returned: 0 in 0.790s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:43 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074b91cd-5f01-4ba2-8fd0-a0d920683292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:43 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1d6efb-2bd3-4bf6-98dc-a90fc4fb533b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:43 devstack sudo[85389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 Feb 27 02:03:43 devstack sudo[85389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:43 devstack sudo[85389]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0" returned: 0 in 0.598s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:43 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074b91cd-5f01-4ba2-8fd0-a0d920683292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:43 devstack sudo[85396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6 Feb 27 02:03:43 devstack sudo[85396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:44 devstack sudo[85379]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-15e310f8-4d6e-430a-9f4c-2aac526246a5 1073741824" returned: 0 in 1.432s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-15e310f8-4d6e-430a-9f4c-2aac526246a5 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:44 devstack sudo[85409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-15e310f8-4d6e-430a-9f4c-2aac526246a5 Feb 27 02:03:44 devstack sudo[85409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:44 devstack sudo[85396]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6" returned: 0 in 0.882s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:44 devstack sudo[85414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6 Feb 27 02:03:44 devstack sudo[85414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:45 devstack sudo[85409]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-15e310f8-4d6e-430a-9f4c-2aac526246a5" returned: 0 in 1.073s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] <== create_volume: return (2603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.606s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66007ff4-91c2-48e1-bad4-ff95506b07bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e310f8-4d6e-430a-9f4c-2aac526246a5', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05dcd355-eb7d-42bf-8a65-a1c7ac765d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:45 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Volume volume-15e310f8-4d6e-430a-9f4c-2aac526246a5 (15e310f8-4d6e-430a-9f4c-2aac526246a5): created successfully Feb 27 02:03:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05dcd355-eb7d-42bf-8a65-a1c7ac765d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Flow 'volume_create_manager' (b05fa3a7-13de-4bb3-a624-e74c5793a8ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:45 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-6cccc320-5f56-4e40-97d7-91e62fceb499 tempest-ServersNegativeTestJSON-1540899718 None] Created volume successfully. Feb 27 02:03:45 devstack sudo[85414]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.8b38063b-9c8e-409e-b161-f71437692ee6" returned: 0 in 0.991s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-quobyte-8b38063b-9c8e-409e-b161-f71437692ee6" released by "_delete_snapshot" :: held 3.355s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-quobyte-074b91cd-5f01-4ba2-8fd0-a0d920683292" released by "delete_snapshot" :: held 3.379s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:45 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] Created reservations ['e9b638f0-a1c4-457f-939f-8ed616297a1b', 'c616dd29-53a3-4b4e-be98-0cf3afb94faa', 'be5cfe93-bc13-4d64-b080-6433ac097cef', '5be7582c-c63c-4c69-b6f6-ecbcd2e2ad0a'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:45 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] Delete snapshot completed successfully. Feb 27 02:03:46 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b81dc80b-a602-4ea8-8b4a-a57683c48757 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-8b38063b-9c8e-409e-b161-f71437692ee6-delete_snapshot" released by "delete_snapshot" :: held 3.618s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:46 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] Acquiring lock "cinder-15e310f8-4d6e-430a-9f4c-2aac526246a5-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:47 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] Lock "cinder-15e310f8-4d6e-430a-9f4c-2aac526246a5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:47 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] Acquiring lock "cinder-quobyte-15e310f8-4d6e-430a-9f4c-2aac526246a5" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:47 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] Lock "cinder-quobyte-15e310f8-4d6e-430a-9f4c-2aac526246a5" acquired by "delete_volume" :: waited 0.038s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-78b047d7-f0d9-4a08-9917-6ac7b5b7bc0b tempest-SnapshotsActionsTest-88137101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-78b047d7-f0d9-4a08-9917-6ac7b5b7bc0b tempest-SnapshotsActionsTest-88137101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:47 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7021d979-ff79-4a20-84b4-8900750aac2f]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-78b047d7-f0d9-4a08-9917-6ac7b5b7bc0b tempest-SnapshotsActionsTest-88137101 None] Creating offline snapshot 0a409c13-91ea-4ee1-abd4-8e3bca0f73db of volume 074b91cd-5f01-4ba2-8fd0-a0d920683292 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:03:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-15e310f8-4d6e-430a-9f4c-2aac526246a5 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:47 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e3789b-4554-442b-8d69-43d4a9311e78]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-78b047d7-f0d9-4a08-9917-6ac7b5b7bc0b tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:47 devstack sudo[85494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-15e310f8-4d6e-430a-9f4c-2aac526246a5 Feb 27 02:03:47 devstack sudo[85494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:47 devstack sudo[85495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 Feb 27 02:03:47 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:48 devstack sudo[85494]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-15e310f8-4d6e-430a-9f4c-2aac526246a5" returned: 0 in 0.881s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-15e310f8-4d6e-430a-9f4c-2aac526246a5 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:48 devstack sudo[85505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-15e310f8-4d6e-430a-9f4c-2aac526246a5 Feb 27 02:03:48 devstack sudo[85505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:48 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-78b047d7-f0d9-4a08-9917-6ac7b5b7bc0b tempest-SnapshotsActionsTest-88137101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0" returned: 0 in 1.323s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:48 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-78b047d7-f0d9-4a08-9917-6ac7b5b7bc0b tempest-SnapshotsActionsTest-88137101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074b91cd-5f01-4ba2-8fd0-a0d920683292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-78b047d7-f0d9-4a08-9917-6ac7b5b7bc0b tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:48 devstack sudo[85836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db 1G Feb 27 02:03:48 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:49 devstack sudo[85505]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-15e310f8-4d6e-430a-9f4c-2aac526246a5" returned: 0 in 1.085s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:49 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] Lock "cinder-quobyte-15e310f8-4d6e-430a-9f4c-2aac526246a5" released by "delete_volume" :: held 2.156s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:49 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] Created reservations ['1a55d487-bd09-4876-95d1-acca6b1f585d', 'ab59ff7f-9b94-4f1a-8358-5d53697b3f34', '300941a6-6141-4123-b43d-781acd7c3374', 'e554a69b-f644-4c45-b303-027ceb783df7'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:49 devstack sudo[85846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:03:49 devstack sudo[85846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:50 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-78b047d7-f0d9-4a08-9917-6ac7b5b7bc0b tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db 1G" returned: 0 in 1.654s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-78b047d7-f0d9-4a08-9917-6ac7b5b7bc0b tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:50 devstack sudo[85852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db Feb 27 02:03:50 devstack sudo[85852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] Acquiring lock "cinder-076487d3-51c8-4cb3-a06f-ad45689ef0aa-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] Lock "cinder-076487d3-51c8-4cb3-a06f-ad45689ef0aa-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] Acquiring lock "cinder-quobyte-076487d3-51c8-4cb3-a06f-ad45689ef0aa" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] Lock "cinder-quobyte-076487d3-51c8-4cb3-a06f-ad45689ef0aa" acquired by "delete_volume" :: waited 0.015s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:50 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e8f8df-ab96-4484-aa4f-09b9272dd997]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:50 devstack sudo[85846]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-076487d3-51c8-4cb3-a06f-ad45689ef0aa {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 1.259s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:50 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:50 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] Deleted volume successfully. Feb 27 02:03:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cf555dd6-ecbc-442e-8ba2-93ca5502df11 tempest-ServersNegativeTestJSON-1540899718 None] Lock "cinder-15e310f8-4d6e-430a-9f4c-2aac526246a5-delete_volume" released by "delete_volume" :: held 3.957s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:51 devstack sudo[85855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-076487d3-51c8-4cb3-a06f-ad45689ef0aa Feb 27 02:03:51 devstack sudo[85855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:51 devstack sudo[85852]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-78b047d7-f0d9-4a08-9917-6ac7b5b7bc0b tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db" returned: 0 in 1.290s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:51 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-78b047d7-f0d9-4a08-9917-6ac7b5b7bc0b tempest-SnapshotsActionsTest-88137101 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db is being set with open permissions: ugo+rw Feb 27 02:03:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-78b047d7-f0d9-4a08-9917-6ac7b5b7bc0b tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:51 devstack sudo[85860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db Feb 27 02:03:51 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:51 devstack sudo[85855]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-076487d3-51c8-4cb3-a06f-ad45689ef0aa" returned: 0 in 1.012s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-076487d3-51c8-4cb3-a06f-ad45689ef0aa {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:51 devstack sudo[85865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-076487d3-51c8-4cb3-a06f-ad45689ef0aa Feb 27 02:03:51 devstack sudo[85865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:52 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-78b047d7-f0d9-4a08-9917-6ac7b5b7bc0b tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db" returned: 0 in 0.855s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-78b047d7-f0d9-4a08-9917-6ac7b5b7bc0b tempest-SnapshotsActionsTest-88137101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.301s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:52 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-78b047d7-f0d9-4a08-9917-6ac7b5b7bc0b tempest-SnapshotsActionsTest-88137101 None] Create snapshot completed successfully Feb 27 02:03:52 devstack sudo[85865]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-076487d3-51c8-4cb3-a06f-ad45689ef0aa" returned: 0 in 0.893s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:52 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] Lock "cinder-quobyte-076487d3-51c8-4cb3-a06f-ad45689ef0aa" released by "delete_volume" :: held 1.954s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:52 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] Created reservations ['de7cb84c-60a4-436a-bdce-29fbb3fe1557', '0915742d-38a9-42bc-80e8-b4471a435b99', '07f869f6-4e5e-47a7-9d74-e54a0d36eb57', '624652a2-35d6-4c0d-a772-48116910a33a'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:52 devstack sudo[85870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:03:52 devstack sudo[85870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:53 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] Acquiring lock "cinder-0a409c13-91ea-4ee1-abd4-8e3bca0f73db-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:53 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-0a409c13-91ea-4ee1-abd4-8e3bca0f73db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:53 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] Acquiring lock "cinder-quobyte-074b91cd-5f01-4ba2-8fd0-a0d920683292" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:53 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-quobyte-074b91cd-5f01-4ba2-8fd0-a0d920683292" acquired by "delete_snapshot" :: waited 0.045s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:53 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] Acquiring lock "cinder-quobyte-0a409c13-91ea-4ee1-abd4-8e3bca0f73db" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:53 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-quobyte-0a409c13-91ea-4ee1-abd4-8e3bca0f73db" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] Deleting offline snapshot 0a409c13-91ea-4ee1-abd4-8e3bca0f73db of volume 074b91cd-5f01-4ba2-8fd0-a0d920683292 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:03:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] snapshot_file for this snap is: volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:03:53 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab5a60f-94a2-4803-9fe5-c291844057b6]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:53 devstack sudo[85873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db Feb 27 02:03:53 devstack sudo[85873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:54 devstack sudo[85870]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 1.152s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:54 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:54 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] Deleted volume successfully. Feb 27 02:03:54 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-35007578-d626-4c2b-a262-29f32f8fa80e tempest-ServersNegativeTestJSON-1540899718 None] Lock "cinder-076487d3-51c8-4cb3-a06f-ad45689ef0aa-delete_volume" released by "delete_volume" :: held 3.391s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:54 devstack sudo[85873]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db" returned: 0 in 1.109s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074b91cd-5f01-4ba2-8fd0-a0d920683292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:54 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[662834fc-4735-419a-a927-fd835018a8ef]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:54 devstack sudo[85902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 Feb 27 02:03:54 devstack sudo[85902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:55 devstack sudo[85902]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0" returned: 0 in 0.906s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074b91cd-5f01-4ba2-8fd0-a0d920683292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:55 devstack sudo[85910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db Feb 27 02:03:55 devstack sudo[85910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:56 devstack sudo[85910]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db" returned: 0 in 0.890s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:56 devstack sudo[85915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db Feb 27 02:03:56 devstack sudo[85915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:57 devstack sudo[85915]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.0a409c13-91ea-4ee1-abd4-8e3bca0f73db" returned: 0 in 0.665s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:57 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-quobyte-0a409c13-91ea-4ee1-abd4-8e3bca0f73db" released by "_delete_snapshot" :: held 3.646s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:57 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-quobyte-074b91cd-5f01-4ba2-8fd0-a0d920683292" released by "delete_snapshot" :: held 3.678s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:57 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] Created reservations ['d5fe4e7b-94c7-41a4-a119-4f7b01e5f2c3', '35c2e70c-81a7-4c48-a97b-a82ee7eff64b', 'b3428bb2-2997-4c39-97c0-8bec3e7ffdd0', '5a1a9717-7e60-47f0-99cb-17d57acfc0dc'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:57 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] Delete snapshot completed successfully. Feb 27 02:03:57 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-93d4a38c-9c2b-4919-95f5-d047c76dff71 tempest-SnapshotsActionsTest-1629509971 None] Lock "cinder-0a409c13-91ea-4ee1-abd4-8e3bca0f73db-delete_snapshot" released by "delete_snapshot" :: held 3.857s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] Acquiring lock "cinder-b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] Lock "cinder-b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] Acquiring lock "cinder-quobyte-074b91cd-5f01-4ba2-8fd0-a0d920683292" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] Lock "cinder-quobyte-074b91cd-5f01-4ba2-8fd0-a0d920683292" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] Acquiring lock "cinder-quobyte-b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] Lock "cinder-quobyte-b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] Deleting offline snapshot b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 of volume 074b91cd-5f01-4ba2-8fd0-a0d920683292 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:03:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] snapshot_file for this snap is: volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:03:58 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3f6973-1fc5-4231-934d-217ed9da4408]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:58 devstack sudo[85921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 Feb 27 02:03:58 devstack sudo[85921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:58 devstack sudo[85921]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0" returned: 0 in 0.493s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074b91cd-5f01-4ba2-8fd0-a0d920683292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:58 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0a417b-59ee-4f64-94ff-d47efea982de]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:58 devstack sudo[85926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292 Feb 27 02:03:58 devstack sudo[85926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:59 devstack sudo[85926]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292" returned: 0 in 0.812s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:59 devstack sudo[85955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 Feb 27 02:03:59 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:00 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0" returned: 0 in 0.620s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:00 devstack sudo[85960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0 Feb 27 02:04:00 devstack sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:00 devstack sudo[85960]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292.b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0" returned: 0 in 0.589s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:00 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] Lock "cinder-quobyte-b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0" released by "_delete_snapshot" :: held 2.611s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:00 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] Lock "cinder-quobyte-074b91cd-5f01-4ba2-8fd0-a0d920683292" released by "delete_snapshot" :: held 2.631s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:00 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] Created reservations ['ece3746e-c332-4f44-9639-a0a8125a5c94', 'd0c2d629-1cef-4cb8-868a-1aa686c2ff0e', '74d12718-e47d-4c5c-adf5-b519f6b8eb81', '726eab42-15d8-43ef-851d-259d2d8b42be'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:01 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] Delete snapshot completed successfully. Feb 27 02:04:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c27a8bd1-52da-456e-9197-6e3a3e50fa2a tempest-SnapshotsActionsTest-88137101 None] Lock "cinder-b83dde6d-aa01-4bf5-ada5-daaaca7a0ab0-delete_snapshot" released by "delete_snapshot" :: held 2.804s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] Acquiring lock "cinder-074b91cd-5f01-4ba2-8fd0-a0d920683292-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] Lock "cinder-074b91cd-5f01-4ba2-8fd0-a0d920683292-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] Acquiring lock "cinder-quobyte-074b91cd-5f01-4ba2-8fd0-a0d920683292" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] Lock "cinder-quobyte-074b91cd-5f01-4ba2-8fd0-a0d920683292" acquired by "delete_volume" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:01 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26846bc-d4e4-4069-9f75-b8c590e9a3de]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:01 devstack sudo[85988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292 Feb 27 02:04:01 devstack sudo[85988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:02 devstack sudo[85988]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292" returned: 0 in 0.676s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:02 devstack sudo[85994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292 Feb 27 02:04:02 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:02 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-074b91cd-5f01-4ba2-8fd0-a0d920683292" returned: 0 in 0.586s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:02 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] Lock "cinder-quobyte-074b91cd-5f01-4ba2-8fd0-a0d920683292" released by "delete_volume" :: held 1.318s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:02 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] Created reservations ['a7086d1b-702e-4462-a38c-231790a1779a', 'a589b094-aa18-4a47-ae34-07ac721a4dd1', 'b5e48134-cf28-4ff1-a500-8fe09d4674c0', '03dbde1d-3a3a-4997-8fda-62751a088cc2'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:03 devstack sudo[85998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:04:03 devstack sudo[85998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:03 devstack sudo[85998]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.576s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:03 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:03 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] Deleted volume successfully. Feb 27 02:04:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c81b7966-9ec0-46f0-9a0d-df17d7489b67 tempest-SnapshotsActionsTest-88137101 None] Lock "cinder-074b91cd-5f01-4ba2-8fd0-a0d920683292-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:09 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-08093e27-f3c9-4323-9319-2a6420e4be84 tempest-GroupSnapshotsTest-1276894660 None] Group tempest-GroupSnapshotsTest-Group-1726910941: creating Feb 27 02:04:09 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-08093e27-f3c9-4323-9319-2a6420e4be84 tempest-GroupSnapshotsTest-1276894660 None] Group tempest-GroupSnapshotsTest-Group-1726910941: created successfully Feb 27 02:04:09 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-08093e27-f3c9-4323-9319-2a6420e4be84 tempest-GroupSnapshotsTest-1276894660 None] Create group completed successfully. Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Flow 'volume_create_manager' (1bc06852-9a0a-44a5-901f-a8d5e54c6094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf40f90-db02-45e8-9bc0-fe249c730519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf40f90-db02-45e8-9bc0-fe249c730519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1708234634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=038618ac-a42f-4de0-a429-20abaa657eeb,host='devstack@QuobyteHD#QuobyteHD',id=79fca543-724c-4db7-8d15-bc241ee4f53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb0e94ee39d49c9ad5bdeeb02f6f944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:11Z,use_quota=True,user_id='2ea39432d49b4b97b25de35a72f6f0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ccd4147-a0d2-4fd1-ab60-7ad1787bf797),volume_type_id=4ccd4147-a0d2-4fd1-ab60-7ad1787bf797)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19c2e75c-b23d-4610-934c-3c02a58d2ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19c2e75c-b23d-4610-934c-3c02a58d2ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44800602-a0c8-4b35-9c94-cbf824a01223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44800602-a0c8-4b35-9c94-cbf824a01223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79fca543-724c-4db7-8d15-bc241ee4f53d', 'volume_name': 'volume-79fca543-724c-4db7-8d15-bc241ee4f53d', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d24a40d-df09-4871-af38-dc7198e469d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d24a40d-df09-4871-af38-dc7198e469d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e45f75-a2a5-4890-acca-feb72e30ef79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:11 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Volume 79fca543-724c-4db7-8d15-bc241ee4f53d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79fca543-724c-4db7-8d15-bc241ee4f53d', 'volume_size': 1} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=038618ac-a42f-4de0-a429-20abaa657eeb,created_at=2026-02-27T01:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1708234634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=038618ac-a42f-4de0-a429-20abaa657eeb,host='devstack@QuobyteHD#QuobyteHD',id=79fca543-724c-4db7-8d15-bc241ee4f53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb0e94ee39d49c9ad5bdeeb02f6f944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:11Z,use_quota=True,user_id='2ea39432d49b4b97b25de35a72f6f0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ccd4147-a0d2-4fd1-ab60-7ad1787bf797),volume_type_id=4ccd4147-a0d2-4fd1-ab60-7ad1787bf797)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Creating volume 79fca543-724c-4db7-8d15-bc241ee4f53d {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:11 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:04:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:11 devstack sudo[86077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d 1073741824 Feb 27 02:04:11 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Flow 'volume_create_manager' (e686843b-54b0-461c-bc87-f167f30f4752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6662ef-58f1-4661-92e8-5310c82ae755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6662ef-58f1-4661-92e8-5310c82ae755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-64312760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=642b9397-13c1-49da-985b-7a1eaca87cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21377b596b04bf28d33420c9bdda4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:12Z,use_quota=True,user_id='bf0d1367e5d14f0698a46e125534621d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac33342d-8c32-4668-b8aa-d992e9abb549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac33342d-8c32-4668-b8aa-d992e9abb549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2eceaeb-57e7-47f0-91d1-5b86ad2094a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2eceaeb-57e7-47f0-91d1-5b86ad2094a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '642b9397-13c1-49da-985b-7a1eaca87cda', 'volume_name': 'volume-642b9397-13c1-49da-985b-7a1eaca87cda', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:12 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5cf4f7-5b6e-48c9-bf10-243b55d29865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5cf4f7-5b6e-48c9-bf10-243b55d29865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49308739-a42a-4133-880d-e07a1b7eb8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:12 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Volume 642b9397-13c1-49da-985b-7a1eaca87cda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-642b9397-13c1-49da-985b-7a1eaca87cda', 'volume_size': 1} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d 1073741824" returned: 0 in 0.892s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:12 devstack sudo[86105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d Feb 27 02:04:12 devstack sudo[86105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:12 devstack sudo[86105]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d" returned: 0 in 0.612s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.659s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-64312760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=642b9397-13c1-49da-985b-7a1eaca87cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21377b596b04bf28d33420c9bdda4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:12Z,use_quota=True,user_id='bf0d1367e5d14f0698a46e125534621d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Creating volume 642b9397-13c1-49da-985b-7a1eaca87cda {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:12 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-642b9397-13c1-49da-985b-7a1eaca87cda 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e45f75-a2a5-4890-acca-feb72e30ef79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79fca543-724c-4db7-8d15-bc241ee4f53d', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b504d51-e798-44da-b60a-203c80d89c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:12 devstack sudo[86110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-642b9397-13c1-49da-985b-7a1eaca87cda 1073741824 Feb 27 02:04:12 devstack sudo[86110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:12 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Volume volume-79fca543-724c-4db7-8d15-bc241ee4f53d (79fca543-724c-4db7-8d15-bc241ee4f53d): created successfully Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b504d51-e798-44da-b60a-203c80d89c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Flow 'volume_create_manager' (1bc06852-9a0a-44a5-901f-a8d5e54c6094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:12 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-18ee1c64-c768-42a3-8b05-56533c603ec5 tempest-GroupSnapshotsTest-1276894660 None] Created volume successfully. Feb 27 02:04:13 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] GroupSnapshot 79897233-3f23-45bc-b1ca-e65825e821d8: creating. Feb 27 02:04:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] Group snapshot 79897233-3f23-45bc-b1ca-e65825e821d8: creating. {{(pid=83231) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:04:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:13 devstack sudo[86110]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-642b9397-13c1-49da-985b-7a1eaca87cda 1073741824" returned: 0 in 0.778s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-642b9397-13c1-49da-985b-7a1eaca87cda {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:13 devstack sudo[86116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-642b9397-13c1-49da-985b-7a1eaca87cda Feb 27 02:04:13 devstack sudo[86116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:14 devstack sudo[86116]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-642b9397-13c1-49da-985b-7a1eaca87cda" returned: 0 in 0.526s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.612s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49308739-a42a-4133-880d-e07a1b7eb8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-642b9397-13c1-49da-985b-7a1eaca87cda', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b6b4fe-3646-4721-aa48-47d99280a13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] Creating offline snapshot 8c45349d-121d-47db-bebd-55facf05e35b of volume 79fca543-724c-4db7-8d15-bc241ee4f53d {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:04:14 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Volume volume-642b9397-13c1-49da-985b-7a1eaca87cda (642b9397-13c1-49da-985b-7a1eaca87cda): created successfully Feb 27 02:04:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b6b4fe-3646-4721-aa48-47d99280a13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Flow 'volume_create_manager' (e686843b-54b0-461c-bc87-f167f30f4752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:14 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c95f142-efef-438d-b8bb-f12f2e081aac]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:14 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-71d39bc7-9773-438d-b144-ddb187727eaf tempest-VolumeQuotasAdminTestJSON-541298799 None] Created volume successfully. Feb 27 02:04:14 devstack sudo[86125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d Feb 27 02:04:14 devstack sudo[86125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:14 devstack sudo[86125]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d" returned: 0 in 0.664s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:14 devstack sudo[86130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b 1G Feb 27 02:04:14 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:15 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] Acquiring lock "cinder-642b9397-13c1-49da-985b-7a1eaca87cda-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:15 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] Lock "cinder-642b9397-13c1-49da-985b-7a1eaca87cda-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:15 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] Acquiring lock "cinder-quobyte-642b9397-13c1-49da-985b-7a1eaca87cda" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:15 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] Lock "cinder-quobyte-642b9397-13c1-49da-985b-7a1eaca87cda" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:15 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1dcdfb-176a-43f1-9cc7-6dae58161506]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-642b9397-13c1-49da-985b-7a1eaca87cda {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:15 devstack sudo[86135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-642b9397-13c1-49da-985b-7a1eaca87cda Feb 27 02:04:15 devstack sudo[86135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:15 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b 1G" returned: 0 in 0.715s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79fca543-724c-4db7-8d15-bc241ee4f53d -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:15 devstack sudo[86139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79fca543-724c-4db7-8d15-bc241ee4f53d -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b Feb 27 02:04:15 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:16 devstack sudo[86135]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-642b9397-13c1-49da-985b-7a1eaca87cda" returned: 0 in 0.785s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-642b9397-13c1-49da-985b-7a1eaca87cda {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:16 devstack sudo[86148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-642b9397-13c1-49da-985b-7a1eaca87cda Feb 27 02:04:16 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:16 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79fca543-724c-4db7-8d15-bc241ee4f53d -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b" returned: 0 in 0.619s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:16 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:04:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:16 devstack sudo[86150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b Feb 27 02:04:16 devstack sudo[86150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:16 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-642b9397-13c1-49da-985b-7a1eaca87cda" returned: 0 in 0.563s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:16 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] Lock "cinder-quobyte-642b9397-13c1-49da-985b-7a1eaca87cda" released by "delete_volume" :: held 1.382s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:16 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] Created reservations ['50168f62-f993-41ca-a409-7faa25583da8', '6d5cb175-76a5-46d8-96c4-2227c78abaa3', 'b3a11f07-f09e-43c6-b4d2-2e6a464f709f', '4fe422ff-b421-4436-ac14-ff51e2a0fc3e'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:16 devstack sudo[86150]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b" returned: 0 in 0.690s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:17 devstack sudo[86154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:04:17 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:17 devstack sudo[86156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.info Feb 27 02:04:17 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:17 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.483s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:17 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:17 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] Deleted volume successfully. Feb 27 02:04:17 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-63c878b6-ef6c-491d-be20-30ee42372371 tempest-VolumeQuotasAdminTestJSON-541298799 None] Lock "cinder-642b9397-13c1-49da-985b-7a1eaca87cda-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:17 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.info" returned: 0 in 0.544s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:17 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:04:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:17 devstack sudo[86160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.info Feb 27 02:04:17 devstack sudo[86160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:17 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Flow 'volume_create_manager' (1b9289d8-2828-4ed9-b26b-c7c03766daf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601a938a-f841-4164-89ad-ec4e8e661d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601a938a-f841-4164-89ad-ec4e8e661d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1056906576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e1e3f9-68cc-4fe1-974e-d14cc55e4f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21377b596b04bf28d33420c9bdda4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:18Z,use_quota=True,user_id='bf0d1367e5d14f0698a46e125534621d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341fb39a-fb41-40de-9b02-7c522709bc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341fb39a-fb41-40de-9b02-7c522709bc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:18 devstack sudo[86160]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5f6bf4-b231-46be-953c-054d81e0530f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5f6bf4-b231-46be-953c-054d81e0530f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51e1e3f9-68cc-4fe1-974e-d14cc55e4f07', 'volume_name': 'volume-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f291c4-3c84-463c-9cb2-d66b66b14e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f291c4-3c84-463c-9cb2-d66b66b14e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c443a8-9a7d-4072-9b0d-ff7057e91a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:18 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Volume 51e1e3f9-68cc-4fe1-974e-d14cc55e4f07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07', 'volume_size': 1} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.info" returned: 0 in 0.520s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.846s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.016s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1056906576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e1e3f9-68cc-4fe1-974e-d14cc55e4f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21377b596b04bf28d33420c9bdda4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:18Z,use_quota=True,user_id='bf0d1367e5d14f0698a46e125534621d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Creating volume 51e1e3f9-68cc-4fe1-974e-d14cc55e4f07 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:18 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:18 devstack sudo[86163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07 1073741824 Feb 27 02:04:18 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:18 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-c724463a-3d6c-4590-9997-09381b2927e0 tempest-GroupSnapshotsTest-1276894660 None] group_snapshot 79897233-3f23-45bc-b1ca-e65825e821d8: created successfully Feb 27 02:04:18 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07 1073741824" returned: 0 in 0.630s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:18 devstack sudo[86168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07 Feb 27 02:04:18 devstack sudo[86168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:19 devstack sudo[86168]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07" returned: 0 in 0.595s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c443a8-9a7d-4072-9b0d-ff7057e91a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437caf87-91c6-4f98-9dc7-722ac8699893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:19 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Volume volume-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07 (51e1e3f9-68cc-4fe1-974e-d14cc55e4f07): created successfully Feb 27 02:04:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437caf87-91c6-4f98-9dc7-722ac8699893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Flow 'volume_create_manager' (1b9289d8-2828-4ed9-b26b-c7c03766daf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:19 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-826d6163-e971-4c81-abee-9b5b91e41a1c tempest-VolumeQuotasAdminTestJSON-541298799 None] Created volume successfully. Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "cinder-quobyte-8c45349d-121d-47db-bebd-55facf05e35b-7ab6236c-9ead-419c-9f4d-62b1f598c3bc" by "_create_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-8c45349d-121d-47db-bebd-55facf05e35b-7ab6236c-9ead-419c-9f4d-62b1f598c3bc" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Creating volume 7ab6236c-9ead-419c-9f4d-62b1f598c3bc from snapshot 8c45349d-121d-47db-bebd-55facf05e35b {{(pid=83231) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "cinder-quobyte-7ab6236c-9ead-419c-9f4d-62b1f598c3bc" by "_copy_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-7ab6236c-9ead-419c-9f4d-62b1f598c3bc" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] snapshot: 8c45349d-121d-47db-bebd-55facf05e35b, volume: 7ab6236c-9ead-419c-9f4d-62b1f598c3bc, {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff0e29c-5293-4cf3-9a13-a3fc1275a526]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:20 devstack sudo[86205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b Feb 27 02:04:20 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:20 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b" returned: 0 in 0.785s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79fca543-724c-4db7-8d15-bc241ee4f53d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Creating direct copy from snapshot {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b433a06-4f96-47ae-813e-3b9c00f6875f]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:21 devstack sudo[86210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d Feb 27 02:04:21 devstack sudo[86210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:21 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-73324f35-8f3b-4791-8267-f756c135c250 tempest-VolumeQuotasAdminTestJSON-448800290 None] Transfer volume completed successfully. Feb 27 02:04:21 devstack sudo[86210]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d" returned: 0 in 0.744s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:21 devstack cinder-volume[83231]: DEBUG cinder.utils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Path /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7ab6236c-9ead-419c-9f4d-62b1f598c3bc not found in is_blk_device check {{(pid=83231) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:04:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7ab6236c-9ead-419c-9f4d-62b1f598c3bc {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:21 devstack sudo[86215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7ab6236c-9ead-419c-9f4d-62b1f598c3bc Feb 27 02:04:21 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] Acquiring lock "cinder-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] Lock "cinder-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] Acquiring lock "cinder-quobyte-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] Lock "cinder-quobyte-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07" acquired by "delete_volume" :: waited 0.032s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:22 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a265cf5e-5eef-4555-a3e9-2e8d0dbbc5d9]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:22 devstack sudo[86225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07 Feb 27 02:04:22 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:23 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07" returned: 0 in 1.302s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:23 devstack sudo[86265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07 Feb 27 02:04:23 devstack sudo[86265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:25 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7ab6236c-9ead-419c-9f4d-62b1f598c3bc" returned: 0 in 3.467s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:25 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d86b851-c890-4b92-aad6-2f2e7966df8c]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:25 devstack sudo[86265]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07" returned: 0 in 1.473s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:25 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] Lock "cinder-quobyte-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07" released by "delete_volume" :: held 2.821s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:25 devstack sudo[86269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d Feb 27 02:04:25 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:25 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] Created reservations ['bf1022b9-1880-492c-85f3-9e1392a920f5', '8f4ffde6-96d4-4331-b233-97b2c0018c0b', '0671b461-475a-4cb7-91b9-75f41bb1f1ad', 'c530c64c-4058-4053-bb26-05a9ee7b6997'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:25 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:25 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:25 devstack sudo[86271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:04:25 devstack sudo[86271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:25 devstack sudo[86271]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.579s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:25 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:25 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] Deleted volume successfully. Feb 27 02:04:25 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77facdc6-aaf1-49aa-8ace-8116dd70ddce tempest-VolumeQuotasAdminTestJSON-1222509620 None] Lock "cinder-51e1e3f9-68cc-4fe1-974e-d14cc55e4f07-delete_volume" released by "delete_volume" :: held 3.627s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:25 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d" returned: 0 in 0.846s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:25 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Image conversion details: src /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d, size 1024.00 MB, duration 3.47 sec, destination /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7ab6236c-9ead-419c-9f4d-62b1f598c3bc {{(pid=83231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:04:25 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Converted 1024.00 MB image at 295.22 MB/s Feb 27 02:04:25 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7ab6236c-9ead-419c-9f4d-62b1f598c3bc is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:04:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7ab6236c-9ead-419c-9f4d-62b1f598c3bc {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:25 devstack sudo[86277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7ab6236c-9ead-419c-9f4d-62b1f598c3bc Feb 27 02:04:25 devstack sudo[86277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:26 devstack sudo[86277]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7ab6236c-9ead-419c-9f4d-62b1f598c3bc" returned: 0 in 0.633s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-7ab6236c-9ead-419c-9f4d-62b1f598c3bc" released by "_copy_volume_from_snapshot" :: held 6.553s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-8c45349d-121d-47db-bebd-55facf05e35b-7ab6236c-9ead-419c-9f4d-62b1f598c3bc" released by "_create_volume_from_snapshot" :: held 6.575s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.586s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:26 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-fbdcc2d3-e477-4ae3-869a-e1db8ec1712a tempest-GroupSnapshotsTest-1276894660 None] Create group from source-snapshot-79897233-3f23-45bc-b1ca-e65825e821d8 completed successfully. Feb 27 02:04:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "cinder-quobyte-7ab6236c-9ead-419c-9f4d-62b1f598c3bc" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-7ab6236c-9ead-419c-9f4d-62b1f598c3bc" acquired by "delete_volume" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:27 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d519a8d-ae8b-480b-b21a-30fe19a1a43f]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7ab6236c-9ead-419c-9f4d-62b1f598c3bc {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:27 devstack sudo[86283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7ab6236c-9ead-419c-9f4d-62b1f598c3bc Feb 27 02:04:27 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:28 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7ab6236c-9ead-419c-9f4d-62b1f598c3bc" returned: 0 in 0.725s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7ab6236c-9ead-419c-9f4d-62b1f598c3bc {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:28 devstack sudo[86288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7ab6236c-9ead-419c-9f4d-62b1f598c3bc Feb 27 02:04:28 devstack sudo[86288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:28 devstack sudo[86288]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7ab6236c-9ead-419c-9f4d-62b1f598c3bc" returned: 0 in 0.526s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-7ab6236c-9ead-419c-9f4d-62b1f598c3bc" released by "delete_volume" :: held 1.292s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:28 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] Created reservations ['64ac7ed6-63a0-492b-b051-df9428c93bfb'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:28 devstack cinder-volume[83231]: WARNING cinder.quota [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1224281609 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1224281609, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:28 devstack cinder-volume[83231]: WARNING cinder.quota [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1224281609 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1224281609, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:28 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] Created reservations ['01d34f63-11f1-4f13-900f-f014fb12d2f4', '9579a666-aaf9-4f7a-a423-9ebd0dbf3abe', '3e6c78de-17f8-4659-9ad6-5f61dc60df8c', 'b867c8fe-cb9b-40ad-a6a8-b3e960505ac3'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:29 devstack sudo[86316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:04:29 devstack sudo[86316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:29 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] group_snapshot 79897233-3f23-45bc-b1ca-e65825e821d8: deleting Feb 27 02:04:30 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] group_snapshot 79897233-3f23-45bc-b1ca-e65825e821d8: deleting {{(pid=83231) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:04:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "cinder-quobyte-79fca543-724c-4db7-8d15-bc241ee4f53d" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-79fca543-724c-4db7-8d15-bc241ee4f53d" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "cinder-quobyte-8c45349d-121d-47db-bebd-55facf05e35b" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-8c45349d-121d-47db-bebd-55facf05e35b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] Deleting offline snapshot 8c45349d-121d-47db-bebd-55facf05e35b of volume 79fca543-724c-4db7-8d15-bc241ee4f53d {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:04:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] snapshot_file for this snap is: volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:04:30 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ac6dd4-4a86-43df-a1be-c6ae4491b1c2]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:30 devstack sudo[86316]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 1.119s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:30 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:30 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-aa14f44f-cdf6-4f7b-ab15-7323e27c29b9 tempest-GroupSnapshotsTest-1276894660 None] Delete group completed successfully. Feb 27 02:04:30 devstack sudo[86321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b Feb 27 02:04:30 devstack sudo[86321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:31 devstack sudo[86321]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b" returned: 0 in 1.079s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79fca543-724c-4db7-8d15-bc241ee4f53d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1331455-e30b-4134-aaea-d361511e63b1]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Flow 'volume_create_manager' (5138af01-622e-4481-a3d2-481a52e1ae10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2321761c-78bd-4573-a785-28697a08763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2321761c-78bd-4573-a785-28697a08763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1764419056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04cf31b-7bb5-4602-a5a1-5568cdfb1646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74411a5720f642899d6cedd50acb0a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:31Z,use_quota=True,user_id='98b93b5d0efe45cda14885e1a4fb8c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac9ed59-2aa9-4a03-aa72-22872225fbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac9ed59-2aa9-4a03-aa72-22872225fbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e8860e-2df1-4fe2-b174-78cd3bff9ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:31 devstack sudo[86326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d Feb 27 02:04:31 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e8860e-2df1-4fe2-b174-78cd3bff9ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c04cf31b-7bb5-4602-a5a1-5568cdfb1646', 'volume_name': 'volume-c04cf31b-7bb5-4602-a5a1-5568cdfb1646', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1658084-d03d-4bad-a852-b6e4abd5e43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1658084-d03d-4bad-a852-b6e4abd5e43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fa514c-691d-4099-9ae6-807aebfc0f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:31 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Volume c04cf31b-7bb5-4602-a5a1-5568cdfb1646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c04cf31b-7bb5-4602-a5a1-5568cdfb1646', 'volume_size': 1} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1764419056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04cf31b-7bb5-4602-a5a1-5568cdfb1646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74411a5720f642899d6cedd50acb0a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:31Z,use_quota=True,user_id='98b93b5d0efe45cda14885e1a4fb8c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Creating volume c04cf31b-7bb5-4602-a5a1-5568cdfb1646 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:31 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:04:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c04cf31b-7bb5-4602-a5a1-5568cdfb1646 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:31 devstack sudo[86328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c04cf31b-7bb5-4602-a5a1-5568cdfb1646 1073741824 Feb 27 02:04:31 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:32 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d" returned: 0 in 0.825s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:32 devstack sudo[86336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b Feb 27 02:04:32 devstack sudo[86336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:32 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c04cf31b-7bb5-4602-a5a1-5568cdfb1646 1073741824" returned: 0 in 0.965s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c04cf31b-7bb5-4602-a5a1-5568cdfb1646 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:32 devstack sudo[86338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c04cf31b-7bb5-4602-a5a1-5568cdfb1646 Feb 27 02:04:32 devstack sudo[86338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:33 devstack sudo[86336]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b" returned: 0 in 0.923s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:33 devstack sudo[86345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b Feb 27 02:04:33 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:33 devstack sudo[86338]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c04cf31b-7bb5-4602-a5a1-5568cdfb1646" returned: 0 in 0.640s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fa514c-691d-4099-9ae6-807aebfc0f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c04cf31b-7bb5-4602-a5a1-5568cdfb1646', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1843062a-7c65-4c35-910b-7ff7a1ef5743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:33 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Volume volume-c04cf31b-7bb5-4602-a5a1-5568cdfb1646 (c04cf31b-7bb5-4602-a5a1-5568cdfb1646): created successfully Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1843062a-7c65-4c35-910b-7ff7a1ef5743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Flow 'volume_create_manager' (5138af01-622e-4481-a3d2-481a52e1ae10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:33 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-189381cf-6d5d-40e0-9d68-37408999291b tempest-VolumesListAdminTestJSON-847089212 None] Created volume successfully. Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:33 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Flow 'volume_create_manager' (b6b14e64-5301-40db-9225-ea8967166e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47903cb2-c99b-4dd8-9d4d-f19f445c5be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47903cb2-c99b-4dd8-9d4d-f19f445c5be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-854694422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1fab94fa02f4c829c3bfd32bfd2405c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:34Z,use_quota=True,user_id='b2ccdaca19e14d848432157d0066abff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59adb27b-0e52-4e4c-885d-1edc5fede63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59adb27b-0e52-4e4c-885d-1edc5fede63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f13e7f0-0126-442c-8a42-7ad6f7439c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f13e7f0-0126-442c-8a42-7ad6f7439c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f', 'volume_name': 'volume-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0273e45b-d8ef-4d37-99b6-e2261fc1935f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0273e45b-d8ef-4d37-99b6-e2261fc1935f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770be12b-8bd6-42b6-ae89-84ebad0abb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:33 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Volume fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f', 'volume_size': 1} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-854694422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1fab94fa02f4c829c3bfd32bfd2405c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:34Z,use_quota=True,user_id='b2ccdaca19e14d848432157d0066abff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Creating volume fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:33 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d.8c45349d-121d-47db-bebd-55facf05e35b" returned: 0 in 0.793s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:33 devstack sudo[86348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f 1073741824 Feb 27 02:04:33 devstack sudo[86348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-8c45349d-121d-47db-bebd-55facf05e35b" released by "_delete_snapshot" :: held 3.742s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-79fca543-724c-4db7-8d15-bc241ee4f53d" released by "delete_snapshot" :: held 3.767s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Flow 'volume_create_manager' (fc9ce174-da00-417c-b0d6-1df9ddae28e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8689e7b-bd72-47ba-8e08-9dd552851eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8689e7b-bd72-47ba-8e08-9dd552851eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1700478887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97288a28-f96e-4db7-bb1b-8e93d2d960c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74411a5720f642899d6cedd50acb0a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:34Z,use_quota=True,user_id='98b93b5d0efe45cda14885e1a4fb8c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e54c7c-47ac-43c4-a102-6b8aed703e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e54c7c-47ac-43c4-a102-6b8aed703e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4274b19e-71ac-4e24-bb8e-37523c8e8849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4274b19e-71ac-4e24-bb8e-37523c8e8849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97288a28-f96e-4db7-bb1b-8e93d2d960c0', 'volume_name': 'volume-97288a28-f96e-4db7-bb1b-8e93d2d960c0', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c7b401-8a38-4d4d-ac12-ad881883b759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c7b401-8a38-4d4d-ac12-ad881883b759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2895cbc7-fe68-4ac6-9917-2e92889434ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:33 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Volume 97288a28-f96e-4db7-bb1b-8e93d2d960c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97288a28-f96e-4db7-bb1b-8e93d2d960c0', 'volume_size': 1} Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:33 devstack cinder-volume[83231]: WARNING cinder.quota [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1224281609 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1224281609, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:33 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] Created reservations ['8369fa73-207d-4463-b64b-ef86274a5272', '4595e3e0-1e3d-4cf2-b22f-d8b21d89c4d0', '20db9bca-6417-45d9-86fc-1bd2785e83c5', 'da40b388-f8e2-4cd1-8dce-b554f53eafb4'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:34 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-543bbdba-3e71-44f4-a8d2-a37825736ca4 tempest-GroupSnapshotsTest-1276894660 None] group_snapshot 79897233-3f23-45bc-b1ca-e65825e821d8: deleted successfully Feb 27 02:04:34 devstack sudo[86348]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f 1073741824" returned: 0 in 0.671s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:34 devstack sudo[86353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f Feb 27 02:04:34 devstack sudo[86353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2967345a-6dc1-458d-8a0f-de3119292ccf tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "cinder-quobyte-79fca543-724c-4db7-8d15-bc241ee4f53d" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2967345a-6dc1-458d-8a0f-de3119292ccf tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-79fca543-724c-4db7-8d15-bc241ee4f53d" acquired by "delete_volume" :: waited 0.019s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:34 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc00481-29d2-47cf-adb6-05803099295e]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2967345a-6dc1-458d-8a0f-de3119292ccf tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:34 devstack sudo[86355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d Feb 27 02:04:34 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:35 devstack sudo[86353]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f" returned: 0 in 0.656s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.184s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1700478887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97288a28-f96e-4db7-bb1b-8e93d2d960c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74411a5720f642899d6cedd50acb0a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:34Z,use_quota=True,user_id='98b93b5d0efe45cda14885e1a4fb8c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Creating volume 97288a28-f96e-4db7-bb1b-8e93d2d960c0 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:35 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-97288a28-f96e-4db7-bb1b-8e93d2d960c0 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:35 devstack sudo[86358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-97288a28-f96e-4db7-bb1b-8e93d2d960c0 1073741824 Feb 27 02:04:35 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770be12b-8bd6-42b6-ae89-84ebad0abb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a99d419-8833-43d4-9a8c-74b84ed43dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:35 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Volume volume-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f (fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f): created successfully Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a99d419-8833-43d4-9a8c-74b84ed43dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Flow 'volume_create_manager' (b6b14e64-5301-40db-9225-ea8967166e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:35 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-96a66e61-2dcb-4131-8119-2bf5748b3236 tempest-VolumesServicesTestJSON-1784224846 None] Created volume successfully. Feb 27 02:04:35 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2967345a-6dc1-458d-8a0f-de3119292ccf tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d" returned: 0 in 0.656s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2967345a-6dc1-458d-8a0f-de3119292ccf tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:35 devstack sudo[86363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d Feb 27 02:04:35 devstack sudo[86363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:35 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-97288a28-f96e-4db7-bb1b-8e93d2d960c0 1073741824" returned: 0 in 0.729s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-97288a28-f96e-4db7-bb1b-8e93d2d960c0 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:35 devstack sudo[86369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-97288a28-f96e-4db7-bb1b-8e93d2d960c0 Feb 27 02:04:35 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:36 devstack sudo[86363]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2967345a-6dc1-458d-8a0f-de3119292ccf tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fca543-724c-4db7-8d15-bc241ee4f53d" returned: 0 in 0.542s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2967345a-6dc1-458d-8a0f-de3119292ccf tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-79fca543-724c-4db7-8d15-bc241ee4f53d" released by "delete_volume" :: held 1.292s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] Acquiring lock "cinder-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] Lock "cinder-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-2967345a-6dc1-458d-8a0f-de3119292ccf tempest-GroupSnapshotsTest-1276894660 None] Created reservations ['14ab9531-2907-47c0-8e4a-78fabb14717b'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] Acquiring lock "cinder-quobyte-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] Lock "cinder-quobyte-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f" acquired by "delete_volume" :: waited 0.025s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:36 devstack cinder-volume[83231]: WARNING cinder.db.sqlalchemy.api [None req-2967345a-6dc1-458d-8a0f-de3119292ccf tempest-GroupSnapshotsTest-1276894660 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1224281609'] Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ba50a9-01f1-470b-9391-afd851521f4f]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-2967345a-6dc1-458d-8a0f-de3119292ccf tempest-GroupSnapshotsTest-1276894660 None] Created reservations ['05fcf0fb-96f4-4b93-b57e-fc2edd4fb5c3', '3fa85a97-3761-40cb-a020-b60e10c57f5a', '29859f13-6fdb-456c-a7e2-cc482f9596ca', 'ce24cff4-1402-44f7-b779-6d407196954c'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2967345a-6dc1-458d-8a0f-de3119292ccf tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2967345a-6dc1-458d-8a0f-de3119292ccf tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2967345a-6dc1-458d-8a0f-de3119292ccf tempest-GroupSnapshotsTest-1276894660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:36 devstack sudo[86373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f Feb 27 02:04:36 devstack sudo[86373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2967345a-6dc1-458d-8a0f-de3119292ccf tempest-GroupSnapshotsTest-1276894660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2967345a-6dc1-458d-8a0f-de3119292ccf tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2967345a-6dc1-458d-8a0f-de3119292ccf tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:36 devstack sudo[86375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:04:36 devstack sudo[86375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:36 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-97288a28-f96e-4db7-bb1b-8e93d2d960c0" returned: 0 in 0.601s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2895cbc7-fe68-4ac6-9917-2e92889434ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97288a28-f96e-4db7-bb1b-8e93d2d960c0', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa63d7f-c296-4492-b3b1-42d0b331012c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:36 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Volume volume-97288a28-f96e-4db7-bb1b-8e93d2d960c0 (97288a28-f96e-4db7-bb1b-8e93d2d960c0): created successfully Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa63d7f-c296-4492-b3b1-42d0b331012c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Flow 'volume_create_manager' (fc9ce174-da00-417c-b0d6-1df9ddae28e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:36 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-881f1517-f52b-4c11-88bf-40239aac9f4c tempest-VolumesListAdminTestJSON-847089212 None] Created volume successfully. Feb 27 02:04:36 devstack sudo[86375]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2967345a-6dc1-458d-8a0f-de3119292ccf tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.526s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-2967345a-6dc1-458d-8a0f-de3119292ccf tempest-GroupSnapshotsTest-1276894660 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:36 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-2967345a-6dc1-458d-8a0f-de3119292ccf tempest-GroupSnapshotsTest-1276894660 None] Delete group completed successfully. Feb 27 02:04:36 devstack sudo[86373]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f" returned: 0 in 0.674s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:36 devstack sudo[86389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f Feb 27 02:04:36 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:37 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-0298de51-4a23-4f4f-93d4-302a1d9d0c2f tempest-GroupSnapshotsTest-1276894660 None] Group tempest-GroupSnapshotsTest-Group-880928782: creating Feb 27 02:04:37 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-0298de51-4a23-4f4f-93d4-302a1d9d0c2f tempest-GroupSnapshotsTest-1276894660 None] Group tempest-GroupSnapshotsTest-Group-880928782: created successfully Feb 27 02:04:37 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-0298de51-4a23-4f4f-93d4-302a1d9d0c2f tempest-GroupSnapshotsTest-1276894660 None] Create group completed successfully. Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:37 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Flow 'volume_create_manager' (af9a6478-dadd-4300-997c-58da02e1d4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ff720f-98be-4250-96e0-0e40850d3e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f" returned: 0 in 0.729s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ff720f-98be-4250-96e0-0e40850d3e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1096725182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d2fd16-ab2d-49dd-8ead-54eb0bafe635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74411a5720f642899d6cedd50acb0a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:38Z,use_quota=True,user_id='98b93b5d0efe45cda14885e1a4fb8c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58f0ad4-4da9-4b34-a03d-b00e79b249cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58f0ad4-4da9-4b34-a03d-b00e79b249cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d48d39-a93d-48e4-870b-0c6e59c28ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d48d39-a93d-48e4-870b-0c6e59c28ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59d2fd16-ab2d-49dd-8ead-54eb0bafe635', 'volume_name': 'volume-59d2fd16-ab2d-49dd-8ead-54eb0bafe635', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495a0b4f-abf2-4068-8ac0-396100c6f311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495a0b4f-abf2-4068-8ac0-396100c6f311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c490a2bf-09f5-4857-800a-7f7d72a9074e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:37 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Volume 59d2fd16-ab2d-49dd-8ead-54eb0bafe635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59d2fd16-ab2d-49dd-8ead-54eb0bafe635', 'volume_size': 1} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1096725182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d2fd16-ab2d-49dd-8ead-54eb0bafe635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74411a5720f642899d6cedd50acb0a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:38Z,use_quota=True,user_id='98b93b5d0efe45cda14885e1a4fb8c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Creating volume 59d2fd16-ab2d-49dd-8ead-54eb0bafe635 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:37 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-59d2fd16-ab2d-49dd-8ead-54eb0bafe635 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] Lock "cinder-quobyte-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f" released by "delete_volume" :: held 1.519s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:37 devstack sudo[86414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-59d2fd16-ab2d-49dd-8ead-54eb0bafe635 1073741824 Feb 27 02:04:37 devstack sudo[86414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] Created reservations ['81981ebb-0b43-452f-b5ed-8ccdf9e034c1', 'ab9a23f1-dfea-4dbe-975d-609105025e74', '12e2065e-b544-4eea-b251-76a6848c120b', '3051a416-b3d6-4b50-bc6d-9750be99d92b'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:37 devstack sudo[86416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:04:37 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:38 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.561s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:38 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:38 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] Deleted volume successfully. Feb 27 02:04:38 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-73291a91-9eea-4769-80fc-43beb57f75d3 tempest-VolumesServicesTestJSON-1784224846 None] Lock "cinder-fa412a7a-2eb8-4588-8f00-9bf77ff9ee1f-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:38 devstack sudo[86414]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-59d2fd16-ab2d-49dd-8ead-54eb0bafe635 1073741824" returned: 0 in 0.716s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-59d2fd16-ab2d-49dd-8ead-54eb0bafe635 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:38 devstack sudo[86422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-59d2fd16-ab2d-49dd-8ead-54eb0bafe635 Feb 27 02:04:38 devstack sudo[86422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:39 devstack sudo[86422]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Flow 'volume_create_manager' (9074f6f7-f594-4a84-937d-9e223fead126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5dc6d5-fbc5-458f-8432-f3e8e6d12b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5dc6d5-fbc5-458f-8432-f3e8e6d12b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1478847192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=438c1f0e-b143-428b-8aee-920b31a61537,host='devstack@QuobyteHD#QuobyteHD',id=8ea2cb3e-f763-45db-afce-40327f614c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb0e94ee39d49c9ad5bdeeb02f6f944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:39Z,use_quota=True,user_id='2ea39432d49b4b97b25de35a72f6f0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a923ff91-66a3-4630-9365-bef1c4e77f64),volume_type_id=a923ff91-66a3-4630-9365-bef1c4e77f64)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efab4dd-920b-4c4e-8cad-a51020116637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efab4dd-920b-4c4e-8cad-a51020116637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f156f0c-b1c7-440e-a6dd-29f19fa73c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f156f0c-b1c7-440e-a6dd-29f19fa73c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ea2cb3e-f763-45db-afce-40327f614c22', 'volume_name': 'volume-8ea2cb3e-f763-45db-afce-40327f614c22', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7275efdb-a13b-4815-8e1d-372af3c72cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7275efdb-a13b-4815-8e1d-372af3c72cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2252c49e-7e6b-4719-9b32-9557708053f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:39 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Volume 8ea2cb3e-f763-45db-afce-40327f614c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ea2cb3e-f763-45db-afce-40327f614c22', 'volume_size': 1} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-59d2fd16-ab2d-49dd-8ead-54eb0bafe635" returned: 0 in 0.836s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=438c1f0e-b143-428b-8aee-920b31a61537,created_at=2026-02-27T01:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1478847192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=438c1f0e-b143-428b-8aee-920b31a61537,host='devstack@QuobyteHD#QuobyteHD',id=8ea2cb3e-f763-45db-afce-40327f614c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb0e94ee39d49c9ad5bdeeb02f6f944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:39Z,use_quota=True,user_id='2ea39432d49b4b97b25de35a72f6f0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a923ff91-66a3-4630-9365-bef1c4e77f64),volume_type_id=a923ff91-66a3-4630-9365-bef1c4e77f64)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Creating volume 8ea2cb3e-f763-45db-afce-40327f614c22 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:39 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c490a2bf-09f5-4857-800a-7f7d72a9074e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d2fd16-ab2d-49dd-8ead-54eb0bafe635', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f88fb1-87f6-4104-8e80-f6e1631cbc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:39 devstack sudo[86425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22 1073741824 Feb 27 02:04:39 devstack sudo[86425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:39 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Volume volume-59d2fd16-ab2d-49dd-8ead-54eb0bafe635 (59d2fd16-ab2d-49dd-8ead-54eb0bafe635): created successfully Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f88fb1-87f6-4104-8e80-f6e1631cbc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Flow 'volume_create_manager' (af9a6478-dadd-4300-997c-58da02e1d4ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:39 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-922dd921-f2b7-40b6-82f6-811c272a4003 tempest-VolumesListAdminTestJSON-847089212 None] Created volume successfully. Feb 27 02:04:40 devstack sudo[86425]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22 1073741824" returned: 0 in 0.936s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:40 devstack sudo[86430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22 Feb 27 02:04:40 devstack sudo[86430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:40 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Flow 'volume_create_manager' (fb7020ad-9795-4d41-a33c-e57b0c30fef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cab2080-a1d8-4768-baea-6b1425358d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cab2080-a1d8-4768-baea-6b1425358d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f57c69-44a4-491c-b724-5b9ad63a80a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92710ec69384bcfb02cd67f7dc4e2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:41Z,use_quota=True,user_id='a0c7dc7506ca4047989adabd9ee834e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18abb340-f03c-42ce-81c3-06f288ace2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18abb340-f03c-42ce-81c3-06f288ace2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecfa958b-ac4b-4f9e-874a-d6f5e50ce7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecfa958b-ac4b-4f9e-874a-d6f5e50ce7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93f57c69-44a4-491c-b724-5b9ad63a80a7', 'volume_name': 'volume-93f57c69-44a4-491c-b724-5b9ad63a80a7', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac524fb-be56-4257-a42f-f8cc1a203e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac524fb-be56-4257-a42f-f8cc1a203e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac37bdc-d616-4eb3-94e8-babc94fb89e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:40 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Volume 93f57c69-44a4-491c-b724-5b9ad63a80a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93f57c69-44a4-491c-b724-5b9ad63a80a7', 'volume_size': 1} Feb 27 02:04:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:41 devstack sudo[86430]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22" returned: 0 in 0.749s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.326s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f57c69-44a4-491c-b724-5b9ad63a80a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92710ec69384bcfb02cd67f7dc4e2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:41Z,use_quota=True,user_id='a0c7dc7506ca4047989adabd9ee834e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Creating volume 93f57c69-44a4-491c-b724-5b9ad63a80a7 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:41 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-93f57c69-44a4-491c-b724-5b9ad63a80a7 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=111,cinder:UPDATE=141,cinder:INSERT=30,cinder:DELETE=7 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2252c49e-7e6b-4719-9b32-9557708053f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea2cb3e-f763-45db-afce-40327f614c22', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e14001-e8bc-4497-abff-07ceb29afe6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:41 devstack sudo[86433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-93f57c69-44a4-491c-b724-5b9ad63a80a7 1073741824 Feb 27 02:04:41 devstack sudo[86433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=111,cinder:UPDATE=112,cinder:DELETE=9,cinder:INSERT=30 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:04:41 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Volume volume-8ea2cb3e-f763-45db-afce-40327f614c22 (8ea2cb3e-f763-45db-afce-40327f614c22): created successfully Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e14001-e8bc-4497-abff-07ceb29afe6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Flow 'volume_create_manager' (9074f6f7-f594-4a84-937d-9e223fead126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:41 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-2a2bd2f1-cb6d-470f-acb4-c68e2e9d8be6 tempest-GroupSnapshotsTest-1276894660 None] Created volume successfully. Feb 27 02:04:41 devstack sudo[86433]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-93f57c69-44a4-491c-b724-5b9ad63a80a7 1073741824" returned: 0 in 0.791s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-93f57c69-44a4-491c-b724-5b9ad63a80a7 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:41 devstack sudo[86438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-93f57c69-44a4-491c-b724-5b9ad63a80a7 Feb 27 02:04:41 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Flow 'volume_create_manager' (e8510fa0-3d98-44a9-a9bb-ba17632fdd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9c93ae-2665-4ece-82c1-23500afc5540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9c93ae-2665-4ece-82c1-23500afc5540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1543704075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=438c1f0e-b143-428b-8aee-920b31a61537,host='devstack@QuobyteHD#QuobyteHD',id=2abe3f4b-5293-479c-90ab-a096a89bcb22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb0e94ee39d49c9ad5bdeeb02f6f944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:42Z,use_quota=True,user_id='2ea39432d49b4b97b25de35a72f6f0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a923ff91-66a3-4630-9365-bef1c4e77f64),volume_type_id=a923ff91-66a3-4630-9365-bef1c4e77f64)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f8a488-8ebf-4f69-96c9-08a18f6ae2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f8a488-8ebf-4f69-96c9-08a18f6ae2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fc7b02-4c54-4096-9301-db50f8f81404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fc7b02-4c54-4096-9301-db50f8f81404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2abe3f4b-5293-479c-90ab-a096a89bcb22', 'volume_name': 'volume-2abe3f4b-5293-479c-90ab-a096a89bcb22', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad52795-19b5-461e-a124-a17cfa080d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad52795-19b5-461e-a124-a17cfa080d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f429d1-7863-4de2-b082-19b0ca2bf6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:42 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Volume 2abe3f4b-5293-479c-90ab-a096a89bcb22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2abe3f4b-5293-479c-90ab-a096a89bcb22', 'volume_size': 1} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:42 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-93f57c69-44a4-491c-b724-5b9ad63a80a7" returned: 0 in 0.708s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.393s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=438c1f0e-b143-428b-8aee-920b31a61537,created_at=2026-02-27T01:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1543704075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=438c1f0e-b143-428b-8aee-920b31a61537,host='devstack@QuobyteHD#QuobyteHD',id=2abe3f4b-5293-479c-90ab-a096a89bcb22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb0e94ee39d49c9ad5bdeeb02f6f944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:42Z,use_quota=True,user_id='2ea39432d49b4b97b25de35a72f6f0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a923ff91-66a3-4630-9365-bef1c4e77f64),volume_type_id=a923ff91-66a3-4630-9365-bef1c4e77f64)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Creating volume 2abe3f4b-5293-479c-90ab-a096a89bcb22 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:42 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac37bdc-d616-4eb3-94e8-babc94fb89e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93f57c69-44a4-491c-b724-5b9ad63a80a7', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ccc0e4-e524-45de-af02-a9295e94d3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:42 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Volume volume-93f57c69-44a4-491c-b724-5b9ad63a80a7 (93f57c69-44a4-491c-b724-5b9ad63a80a7): created successfully Feb 27 02:04:42 devstack sudo[86445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22 1073741824 Feb 27 02:04:42 devstack sudo[86445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ccc0e4-e524-45de-af02-a9295e94d3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Flow 'volume_create_manager' (fb7020ad-9795-4d41-a33c-e57b0c30fef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:42 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-9bdb7768-496e-4e47-8e27-e99419d670f2 tempest-VolumesListAdminTestJSON-908503572 None] Created volume successfully. Feb 27 02:04:43 devstack sudo[86445]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22 1073741824" returned: 0 in 0.853s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:43 devstack sudo[86450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22 Feb 27 02:04:43 devstack sudo[86450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:43 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] Acquiring lock "cinder-93f57c69-44a4-491c-b724-5b9ad63a80a7-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:43 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] Lock "cinder-93f57c69-44a4-491c-b724-5b9ad63a80a7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:43 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] Acquiring lock "cinder-quobyte-93f57c69-44a4-491c-b724-5b9ad63a80a7" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:43 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] Lock "cinder-quobyte-93f57c69-44a4-491c-b724-5b9ad63a80a7" acquired by "delete_volume" :: waited 0.038s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] Acquiring lock "cinder-59d2fd16-ab2d-49dd-8ead-54eb0bafe635-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:44 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8755f4b8-2240-4842-8f0f-33d3e603acc1]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-93f57c69-44a4-491c-b724-5b9ad63a80a7 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] Lock "cinder-59d2fd16-ab2d-49dd-8ead-54eb0bafe635-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] Acquiring lock "cinder-quobyte-59d2fd16-ab2d-49dd-8ead-54eb0bafe635" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] Lock "cinder-quobyte-59d2fd16-ab2d-49dd-8ead-54eb0bafe635" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:44 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee6111c-d365-4e24-b716-9c87eb793ed1]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-59d2fd16-ab2d-49dd-8ead-54eb0bafe635 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:44 devstack sudo[86452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-93f57c69-44a4-491c-b724-5b9ad63a80a7 Feb 27 02:04:44 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:44 devstack sudo[86450]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22" returned: 0 in 0.839s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:44 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f429d1-7863-4de2-b082-19b0ca2bf6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2abe3f4b-5293-479c-90ab-a096a89bcb22', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcfd7db3-5333-4763-9e12-a97a46587414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:44 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Volume volume-2abe3f4b-5293-479c-90ab-a096a89bcb22 (2abe3f4b-5293-479c-90ab-a096a89bcb22): created successfully Feb 27 02:04:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcfd7db3-5333-4763-9e12-a97a46587414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:44 devstack sudo[86454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-59d2fd16-ab2d-49dd-8ead-54eb0bafe635 Feb 27 02:04:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Flow 'volume_create_manager' (e8510fa0-3d98-44a9-a9bb-ba17632fdd77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:44 devstack sudo[86454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:44 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-fda33c71-3f4d-4549-b9dc-cfb8199b4ad0 tempest-GroupSnapshotsTest-1276894660 None] Created volume successfully. Feb 27 02:04:44 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-93f57c69-44a4-491c-b724-5b9ad63a80a7" returned: 0 in 0.939s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-93f57c69-44a4-491c-b724-5b9ad63a80a7 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:44 devstack sudo[86461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-93f57c69-44a4-491c-b724-5b9ad63a80a7 Feb 27 02:04:44 devstack sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:45 devstack sudo[86454]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-59d2fd16-ab2d-49dd-8ead-54eb0bafe635" returned: 0 in 0.933s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-59d2fd16-ab2d-49dd-8ead-54eb0bafe635 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:45 devstack sudo[86465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-59d2fd16-ab2d-49dd-8ead-54eb0bafe635 Feb 27 02:04:45 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:45 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-d78042f3-d776-4b91-965c-17a5c43684ec tempest-GroupSnapshotsTest-1276894660 None] Update group completed successfully. Feb 27 02:04:45 devstack sudo[86461]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-93f57c69-44a4-491c-b724-5b9ad63a80a7" returned: 0 in 0.835s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] Lock "cinder-quobyte-93f57c69-44a4-491c-b724-5b9ad63a80a7" released by "delete_volume" :: held 1.815s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:45 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-59d2fd16-ab2d-49dd-8ead-54eb0bafe635" returned: 0 in 0.691s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] Lock "cinder-quobyte-59d2fd16-ab2d-49dd-8ead-54eb0bafe635" released by "delete_volume" :: held 1.657s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:45 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] Created reservations ['c9270166-8732-49e9-b349-9840dbcaaeab', '12325488-822e-41c7-bc81-9bd39cbba2fa', '8c2753a6-ec22-49f5-b4a9-e932fd6ab357', 'f7ebb287-1e21-4728-bc44-c6746102f0f1'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:46 devstack sudo[86469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:04:46 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:46 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] Created reservations ['d40008f5-d53f-41a0-afc8-8070c82c3f7d', 'af82c1df-61da-4528-88a5-f4a8c99e609b', 'bd02a1f1-62e4-40b6-aa47-20bc6806e70a', 'b927a4f6-71b1-4589-9d7d-5f8ea32e81b1'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:46 devstack sudo[86471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:04:46 devstack sudo[86471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:46 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] Acquiring lock "cinder-97288a28-f96e-4db7-bb1b-8e93d2d960c0-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:46 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] Lock "cinder-97288a28-f96e-4db7-bb1b-8e93d2d960c0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:46 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] Acquiring lock "cinder-quobyte-97288a28-f96e-4db7-bb1b-8e93d2d960c0" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:46 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] Lock "cinder-quobyte-97288a28-f96e-4db7-bb1b-8e93d2d960c0" acquired by "delete_volume" :: waited 0.046s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:46 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79ede86-a055-4f0f-a795-f27f015b3620]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-97288a28-f96e-4db7-bb1b-8e93d2d960c0 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:46 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.902s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:46 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:46 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] Deleted volume successfully. Feb 27 02:04:46 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-445ea793-2e8a-46b3-9762-e8ee2ea1a03a tempest-VolumesListAdminTestJSON-908503572 None] Lock "cinder-93f57c69-44a4-491c-b724-5b9ad63a80a7-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:46 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-32cc00b8-d068-428f-ac13-990be037edb2 tempest-GroupSnapshotsTest-1276894660 None] Update group completed successfully. Feb 27 02:04:47 devstack sudo[86474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-97288a28-f96e-4db7-bb1b-8e93d2d960c0 Feb 27 02:04:47 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:47 devstack cinder-volume[83231]: DEBUG oslo_service.periodic_task [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83231) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:04:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:47 devstack sudo[86493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:04:47 devstack sudo[86493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:47 devstack sudo[86471]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 1.321s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:47 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:47 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] Deleted volume successfully. Feb 27 02:04:47 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4626858c-a52a-4de1-98e2-6eba2475db36 tempest-VolumesListAdminTestJSON-847089212 None] Lock "cinder-59d2fd16-ab2d-49dd-8ead-54eb0bafe635-delete_volume" released by "delete_volume" :: held 3.440s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:48 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-97288a28-f96e-4db7-bb1b-8e93d2d960c0" returned: 0 in 1.367s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-97288a28-f96e-4db7-bb1b-8e93d2d960c0 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:48 devstack sudo[86499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-97288a28-f96e-4db7-bb1b-8e93d2d960c0 Feb 27 02:04:48 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:48 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-342f55eb-4df8-4b1b-b4a9-10ed8725af6d tempest-GroupSnapshotsTest-1276894660 None] Update group completed successfully. Feb 27 02:04:48 devstack sudo[86493]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 1.340s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:48 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:49 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-97288a28-f96e-4db7-bb1b-8e93d2d960c0" returned: 0 in 0.970s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:49 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] Lock "cinder-quobyte-97288a28-f96e-4db7-bb1b-8e93d2d960c0" released by "delete_volume" :: held 2.376s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:49 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] Created reservations ['60d24880-cb0e-4ccc-b57c-9390410fa1b0', 'd4602e52-7366-4334-9cc0-f7cba3787549', 'ebfe43c1-6039-4826-8980-25d052f0b341', 'c8c1a81a-2ad3-45ac-82d3-5cdc7d9d64bc'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:49 devstack sudo[86504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:04:49 devstack sudo[86504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:49 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-d55bdafe-d927-4e69-8e06-bf4e1ea0c73f tempest-GroupSnapshotsTest-1276894660 None] Update group completed successfully. Feb 27 02:04:49 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Flow 'volume_create_manager' (f6b2b97f-f80c-4b09-9e6b-88b9b7a5a1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a61035-3513-4fe4-8722-ff9e12b480a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a61035-3513-4fe4-8722-ff9e12b480a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:50Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6d27b0-cd96-45d7-a60c-22aeb786db23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452ffa5eda324e439dd81cfbbb6625b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:50Z,use_quota=True,user_id='1414300d454a4d4e8c20ee14fdb6138f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fb29c4-1ae6-4602-8e2f-ab8750473f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fb29c4-1ae6-4602-8e2f-ab8750473f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b6f146-3bf1-4167-a9e2-ba270a659064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG cinder.image.glance [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Creating Keystone auth plugin from conf {{(pid=83231) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] Acquiring lock "cinder-c04cf31b-7bb5-4602-a5a1-5568cdfb1646-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] Lock "cinder-c04cf31b-7bb5-4602-a5a1-5568cdfb1646-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] Acquiring lock "cinder-quobyte-c04cf31b-7bb5-4602-a5a1-5568cdfb1646" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] Lock "cinder-quobyte-c04cf31b-7bb5-4602-a5a1-5568cdfb1646" acquired by "delete_volume" :: waited 0.025s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[29eea756-33be-4fe9-bf14-d0de50551f50]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c04cf31b-7bb5-4602-a5a1-5568cdfb1646 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:50 devstack sudo[86504]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 1.082s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:50 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] Deleted volume successfully. Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8a8c1815-bae1-45a2-8b42-51f0f1100eeb tempest-VolumesListAdminTestJSON-847089212 None] Lock "cinder-97288a28-f96e-4db7-bb1b-8e93d2d960c0-delete_volume" released by "delete_volume" :: held 3.942s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:50 devstack sudo[86508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c04cf31b-7bb5-4602-a5a1-5568cdfb1646 Feb 27 02:04:50 devstack sudo[86508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:50 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] GroupSnapshot 19676d73-1cdf-4437-ad77-8bd9cf399282: creating. Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Group snapshot 19676d73-1cdf-4437-ad77-8bd9cf399282: creating. {{(pid=83231) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Creating offline snapshot 90981bb5-18fd-4873-b84b-417042acfb8e of volume 2abe3f4b-5293-479c-90ab-a096a89bcb22 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bfad55-2b56-4313-92fb-36d592a13dae]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b6f146-3bf1-4167-a9e2-ba270a659064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2c6d27b0-cd96-45d7-a60c-22aeb786db23', 'volume_name': 'volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23', 'volume_size': 1, 'image_id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '264ceeea24524ec49624b8e3d37f06d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ad2626-548d-43c2-9b1e-be6ce62d9d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ad2626-548d-43c2-9b1e-be6ce62d9d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f3ad56-c02c-4b0b-9831-2143b0dc837a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:51 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Volume 2c6d27b0-cd96-45d7-a60c-22aeb786db23: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23', 'volume_size': 1, 'image_id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '264ceeea24524ec49624b8e3d37f06d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:04:51 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Trying to clone 2c6d27b0-cd96-45d7-a60c-22aeb786db23 from image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}]). {{(pid=83231) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:04:51 devstack sudo[86510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22 Feb 27 02:04:51 devstack sudo[86510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:51 devstack sudo[86508]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c04cf31b-7bb5-4602-a5a1-5568cdfb1646" returned: 0 in 1.104s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c04cf31b-7bb5-4602-a5a1-5568cdfb1646 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:51 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_0agl_174devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83231) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:04:51 devstack cinder-volume[83231]: INFO cinder.image.image_utils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:04:51 devstack sudo[86536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c04cf31b-7bb5-4602-a5a1-5568cdfb1646 Feb 27 02:04:51 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:51 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[541306e7-657e-47e1-8c7d-36f2b0eda4e1]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_0agl_174devstack@QuobyteHD {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:51 devstack sudo[86538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_0agl_174devstack@QuobyteHD Feb 27 02:04:51 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:52 devstack sudo[86510]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22" returned: 0 in 1.133s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:52 devstack sudo[86544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e 1G Feb 27 02:04:52 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:52 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c04cf31b-7bb5-4602-a5a1-5568cdfb1646" returned: 0 in 0.863s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:52 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] Lock "cinder-quobyte-c04cf31b-7bb5-4602-a5a1-5568cdfb1646" released by "delete_volume" :: held 2.018s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:52 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] Created reservations ['c5006f0d-aced-45f3-be40-683c79b1b455', '4c7d40e7-83fc-4368-8f9b-dab09eeb1f8a', '3cce3e30-33d8-4cff-a543-670c24373f93', '4d4d9e5b-1168-4079-ad56-59a06b65fdd9'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:52 devstack sudo[86557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:04:52 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:52 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_0agl_174devstack@QuobyteHD" returned: 0 in 1.270s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:52 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Temporary image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 is fetched for user 1414300d454a4d4e8c20ee14fdb6138f. {{(pid=83231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:04:52 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc8d109-5f96-4f1b-bbb9-30e6a066a3a0]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_0agl_174devstack@QuobyteHD {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:53 devstack sudo[86563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_0agl_174devstack@QuobyteHD Feb 27 02:04:53 devstack sudo[86563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:53 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e 1G" returned: 0 in 1.376s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2abe3f4b-5293-479c-90ab-a096a89bcb22 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:53 devstack sudo[86597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2abe3f4b-5293-479c-90ab-a096a89bcb22 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e Feb 27 02:04:53 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:53 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 1.371s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:53 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:53 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] Deleted volume successfully. Feb 27 02:04:53 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7dfbd411-5ab8-4487-84ba-e0522df46da1 tempest-VolumesListAdminTestJSON-847089212 None] Lock "cinder-c04cf31b-7bb5-4602-a5a1-5568cdfb1646-delete_volume" released by "delete_volume" :: held 3.801s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:54 devstack sudo[86563]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_0agl_174devstack@QuobyteHD" returned: 0 in 1.181s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:54 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2abe3f4b-5293-479c-90ab-a096a89bcb22 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e" returned: 0 in 0.878s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:54 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:04:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:54 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e Feb 27 02:04:54 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:55 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e" returned: 0 in 0.746s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:55 devstack sudo[86615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.info Feb 27 02:04:55 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:55 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Flow 'volume_create_manager' (a4b5f36e-fd03-4568-b024-bd208df82c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140bf7dc-6e43-4b8c-b80c-5dbfc3ba6007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140bf7dc-6e43-4b8c-b80c-5dbfc3ba6007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-891839535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=839b77f2-fcdf-44ee-8537-160eff04655b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ad4b1d2c284805b0c298233bfc2597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:55Z,use_quota=True,user_id='5b060b7fbf60460087833b0eb61eb9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80863721-70c0-4ff9-b908-f959d701295f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80863721-70c0-4ff9-b908-f959d701295f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1704bc-b142-4019-9d20-e4897b15b077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1704bc-b142-4019-9d20-e4897b15b077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '839b77f2-fcdf-44ee-8537-160eff04655b', 'volume_name': 'volume-839b77f2-fcdf-44ee-8537-160eff04655b', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a1b490f-c134-4391-973d-938cbc94075b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a1b490f-c134-4391-973d-938cbc94075b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa329a42-0115-4a74-a9e6-f4ef4ca292f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:55 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Volume 839b77f2-fcdf-44ee-8537-160eff04655b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-839b77f2-fcdf-44ee-8537-160eff04655b', 'volume_size': 1} Feb 27 02:04:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:55 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.info" returned: 0 in 0.743s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:55 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:04:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:55 devstack sudo[86619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.info Feb 27 02:04:55 devstack sudo[86619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:56 devstack sudo[86619]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.info" returned: 0 in 0.747s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.764s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:56 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Creating offline snapshot e89d80b7-a813-48b6-b6b1-751b3fa96571 of volume 8ea2cb3e-f763-45db-afce-40327f614c22 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:04:56 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a719cce-dedc-4ee3-bcb9-490aeb36904d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:56 devstack sudo[86622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22 Feb 27 02:04:56 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:57 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22" returned: 0 in 0.697s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:57 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571 1G Feb 27 02:04:57 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:58 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Flow 'volume_create_manager' (bebd052c-6174-4a0b-88b1-75f18b28f624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbe44c4-ebfb-4536-864d-cccf53164031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571 1G" returned: 0 in 0.779s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ea2cb3e-f763-45db-afce-40327f614c22 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:58 devstack sudo[86634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ea2cb3e-f763-45db-afce-40327f614c22 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571 Feb 27 02:04:58 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbe44c4-ebfb-4536-864d-cccf53164031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-596789406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad5b0c8-941a-41b6-8dfd-702b4c2c265a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53425b48f1d4458999194c11d4b24398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:58Z,use_quota=True,user_id='6e7d9b054d824b0c932d7894b36ea285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db89c8e3-9d9d-4f6c-9676-0f1b59e68188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db89c8e3-9d9d-4f6c-9676-0f1b59e68188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9124d59e-0859-4b5e-beaf-f00f22b88598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG cinder.image.glance [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Creating Keystone auth plugin from conf {{(pid=83231) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9124d59e-0859-4b5e-beaf-f00f22b88598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bad5b0c8-941a-41b6-8dfd-702b4c2c265a', 'volume_name': 'volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a', 'volume_size': 1, 'image_id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '264ceeea24524ec49624b8e3d37f06d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92fd759-9970-48ed-b09c-219a327270db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92fd759-9970-48ed-b09c-219a327270db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc91a6d-715c-422f-80f3-52f0a2140ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:58 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Volume bad5b0c8-941a-41b6-8dfd-702b4c2c265a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a', 'volume_size': 1, 'image_id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '264ceeea24524ec49624b8e3d37f06d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Trying to clone bad5b0c8-941a-41b6-8dfd-702b4c2c265a from image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}]). {{(pid=83231) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_5xm7jy_jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83231) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:04:58 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed09a3b-e9d1-4ba5-9f3e-167063fe361b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_5xm7jy_jdevstack@QuobyteHD {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:58 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ea2cb3e-f763-45db-afce-40327f614c22 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571" returned: 0 in 0.596s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:58 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:04:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:58 devstack sudo[86641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571 Feb 27 02:04:58 devstack sudo[86641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:58 devstack sudo[86640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_5xm7jy_jdevstack@QuobyteHD Feb 27 02:04:58 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:59 devstack sudo[86641]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571" returned: 0 in 0.528s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:59 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_5xm7jy_jdevstack@QuobyteHD" returned: 0 in 0.608s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:59 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Temporary image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 is fetched for user 6e7d9b054d824b0c932d7894b36ea285. {{(pid=83231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:04:59 devstack sudo[86648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.info Feb 27 02:04:59 devstack sudo[86648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:59 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e153a391-ea98-4c76-907e-768da7a24510]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_5xm7jy_jdevstack@QuobyteHD {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:59 devstack sudo[86650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_5xm7jy_jdevstack@QuobyteHD Feb 27 02:04:59 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:59 devstack sudo[86648]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.info" returned: 0 in 0.558s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:59 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:04:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:59 devstack sudo[86657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.info Feb 27 02:04:59 devstack sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:00 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_5xm7jy_jdevstack@QuobyteHD" returned: 0 in 0.621s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:00 devstack sudo[86657]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.info" returned: 0 in 0.575s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.806s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.952s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-891839535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=839b77f2-fcdf-44ee-8537-160eff04655b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ad4b1d2c284805b0c298233bfc2597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:55Z,use_quota=True,user_id='5b060b7fbf60460087833b0eb61eb9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Creating volume 839b77f2-fcdf-44ee-8537-160eff04655b {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:00 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:05:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-839b77f2-fcdf-44ee-8537-160eff04655b 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:00 devstack sudo[86660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-839b77f2-fcdf-44ee-8537-160eff04655b 1073741824 Feb 27 02:05:00 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:00 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-fe741b5c-7482-47fd-93e3-68f3dc839211 tempest-GroupSnapshotsTest-1276894660 None] group_snapshot 19676d73-1cdf-4437-ad77-8bd9cf399282: created successfully Feb 27 02:05:01 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-839b77f2-fcdf-44ee-8537-160eff04655b 1073741824" returned: 0 in 0.750s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-839b77f2-fcdf-44ee-8537-160eff04655b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:01 devstack sudo[86665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-839b77f2-fcdf-44ee-8537-160eff04655b Feb 27 02:05:01 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:01 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] group_snapshot 19676d73-1cdf-4437-ad77-8bd9cf399282: deleting Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] group_snapshot 19676d73-1cdf-4437-ad77-8bd9cf399282: deleting {{(pid=83231) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "cinder-quobyte-2abe3f4b-5293-479c-90ab-a096a89bcb22" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-2abe3f4b-5293-479c-90ab-a096a89bcb22" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "cinder-quobyte-90981bb5-18fd-4873-b84b-417042acfb8e" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-90981bb5-18fd-4873-b84b-417042acfb8e" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Deleting offline snapshot 90981bb5-18fd-4873-b84b-417042acfb8e of volume 2abe3f4b-5293-479c-90ab-a096a89bcb22 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] snapshot_file for this snap is: volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9488ae5e-179f-4107-8f88-880e53a5d92f]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:01 devstack sudo[86667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e Feb 27 02:05:01 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:01 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-839b77f2-fcdf-44ee-8537-160eff04655b" returned: 0 in 0.574s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.794s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:50Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6d27b0-cd96-45d7-a60c-22aeb786db23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452ffa5eda324e439dd81cfbbb6625b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:50Z,use_quota=True,user_id='1414300d454a4d4e8c20ee14fdb6138f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Creating volume 2c6d27b0-cd96-45d7-a60c-22aeb786db23 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:01 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa329a42-0115-4a74-a9e6-f4ef4ca292f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-839b77f2-fcdf-44ee-8537-160eff04655b', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:01 devstack sudo[86670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 1073741824 Feb 27 02:05:01 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1405f7-2f2f-4717-b217-c0e79fd9efa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:01 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Volume volume-839b77f2-fcdf-44ee-8537-160eff04655b (839b77f2-fcdf-44ee-8537-160eff04655b): created successfully Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1405f7-2f2f-4717-b217-c0e79fd9efa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:01 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Flow 'volume_create_manager' (a4b5f36e-fd03-4568-b024-bd208df82c0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:01 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-65fe32f8-7b04-410b-8d97-23cfb4a27462 tempest-VolumesTransfersTest-920993639 None] Created volume successfully. Feb 27 02:05:02 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e" returned: 0 in 0.708s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:02 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2abe3f4b-5293-479c-90ab-a096a89bcb22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:02 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[724acac9-328c-4651-808e-2903dbde1b5f]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:02 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22 Feb 27 02:05:02 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:02 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 1073741824" returned: 0 in 0.794s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:02 devstack sudo[86681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 Feb 27 02:05:02 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:03 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22" returned: 0 in 0.652s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:03 devstack sudo[86686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e Feb 27 02:05:03 devstack sudo[86686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:03 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23" returned: 0 in 0.513s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.222s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-596789406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad5b0c8-941a-41b6-8dfd-702b4c2c265a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53425b48f1d4458999194c11d4b24398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:58Z,use_quota=True,user_id='6e7d9b054d824b0c932d7894b36ea285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Creating volume bad5b0c8-941a-41b6-8dfd-702b4c2c265a {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:03 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG cinder.volume.volume_utils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Attempting download of e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}])) to volume 2c6d27b0-cd96-45d7-a60c-22aeb786db23. {{(pid=83231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:05:03 devstack sudo[86689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a 1073741824 Feb 27 02:05:03 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8f14a9-47b0-4c86-a141-3c4393bf09a5]: (4, 'raw') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_q1nqnzpl {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:03 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_q1nqnzpl Feb 27 02:05:03 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:03 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b97b833f-518c-42cb-8b9b-7b7f67dd0b81 tempest-VolumesTransfersTest-1166159438 None] Transfer volume completed successfully. Feb 27 02:05:03 devstack sudo[86686]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e" returned: 0 in 0.711s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:03 devstack sudo[86698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e Feb 27 02:05:03 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:04 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_q1nqnzpl" returned: 0 in 0.724s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_q1nqnzpl {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:04 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a 1073741824" returned: 0 in 0.848s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:04 devstack sudo[86704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a Feb 27 02:05:04 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:04 devstack sudo[86703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_q1nqnzpl Feb 27 02:05:04 devstack sudo[86703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:04 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22.90981bb5-18fd-4873-b84b-417042acfb8e" returned: 0 in 0.661s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-90981bb5-18fd-4873-b84b-417042acfb8e" released by "_delete_snapshot" :: held 2.842s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-2abe3f4b-5293-479c-90ab-a096a89bcb22" released by "delete_snapshot" :: held 2.857s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "cinder-quobyte-8ea2cb3e-f763-45db-afce-40327f614c22" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-8ea2cb3e-f763-45db-afce-40327f614c22" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "cinder-quobyte-e89d80b7-a813-48b6-b6b1-751b3fa96571" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-e89d80b7-a813-48b6-b6b1-751b3fa96571" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Deleting offline snapshot e89d80b7-a813-48b6-b6b1-751b3fa96571 of volume 8ea2cb3e-f763-45db-afce-40327f614c22 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] snapshot_file for this snap is: volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e826192b-b65e-4e1f-9bd2-631b443b460d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] Acquiring lock "cinder-839b77f2-fcdf-44ee-8537-160eff04655b-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] Lock "cinder-839b77f2-fcdf-44ee-8537-160eff04655b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] Acquiring lock "cinder-quobyte-839b77f2-fcdf-44ee-8537-160eff04655b" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] Lock "cinder-quobyte-839b77f2-fcdf-44ee-8537-160eff04655b" acquired by "delete_volume" :: waited 0.023s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:04 devstack sudo[86708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571 Feb 27 02:05:04 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b9af7b-beb9-43d7-9adc-0aa7cc778061]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-839b77f2-fcdf-44ee-8537-160eff04655b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:04 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a" returned: 0 in 0.769s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:04 devstack cinder-volume[83231]: DEBUG cinder.volume.volume_utils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Attempting download of e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}])) to volume bad5b0c8-941a-41b6-8dfd-702b4c2c265a. {{(pid=83231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:05:04 devstack sudo[86711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-839b77f2-fcdf-44ee-8537-160eff04655b Feb 27 02:05:04 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:05 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2845723-9581-4e99-b800-fe8aa53b2455]: (4, 'raw') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_ncwizgna {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:05 devstack sudo[86703]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_q1nqnzpl" returned: 1 in 0.925s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_q1nqnzpl' failed. Not Retrying. {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:05:05 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a9df86-9ff5-475f-a077-3377bfabc283]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_0agl_174devstack@QuobyteHD {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:05 devstack sudo[86715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_ncwizgna Feb 27 02:05:05 devstack sudo[86715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:05 devstack sudo[86716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_0agl_174devstack@QuobyteHD Feb 27 02:05:05 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:05 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-839b77f2-fcdf-44ee-8537-160eff04655b" returned: 0 in 0.780s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-839b77f2-fcdf-44ee-8537-160eff04655b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:05 devstack sudo[86725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-839b77f2-fcdf-44ee-8537-160eff04655b Feb 27 02:05:05 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:05 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571" returned: 0 in 1.071s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:05 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ea2cb3e-f763-45db-afce-40327f614c22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:05 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7cfce0-e8c8-4df3-8516-8e5178241529]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:05 devstack sudo[86728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22 Feb 27 02:05:05 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:05 devstack sudo[86715]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_ncwizgna" returned: 0 in 0.844s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_ncwizgna {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:05 devstack sudo[86731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_ncwizgna Feb 27 02:05:05 devstack sudo[86731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:06 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_0agl_174devstack@QuobyteHD" returned: 0 in 1.013s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:06 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 was qcow2, converting to raw {{(pid=83231) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:05:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_0agl_174devstack@QuobyteHD /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:06 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_0agl_174devstack@QuobyteHD /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 Feb 27 02:05:06 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:06 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-839b77f2-fcdf-44ee-8537-160eff04655b" returned: 0 in 0.676s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:06 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] Lock "cinder-quobyte-839b77f2-fcdf-44ee-8537-160eff04655b" released by "delete_volume" :: held 1.489s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:06 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] Created reservations ['712554c7-5634-4aae-a6ce-c79d6d8b1b39', '595d71fb-eade-4d26-8679-9538ebfa6fe1', 'c14b37f4-bc63-4da3-b820-f778870c07e2', 'c23d38ed-7af0-4fe9-9a66-9705cdce7319'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:06 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22" returned: 0 in 0.652s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:06 devstack sudo[86744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571 Feb 27 02:05:06 devstack sudo[86744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:06 devstack sudo[86746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:05:06 devstack sudo[86746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:06 devstack sudo[86731]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_ncwizgna" returned: 1 in 0.609s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_ncwizgna' failed. Not Retrying. {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:05:06 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a6dedf-36c0-493e-8254-04df1726b1eb]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_5xm7jy_jdevstack@QuobyteHD {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:06 devstack sudo[86749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_5xm7jy_jdevstack@QuobyteHD Feb 27 02:05:06 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:07 devstack sudo[86744]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571" returned: 0 in 0.682s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:07 devstack sudo[86746]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.668s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:07 devstack sudo[86761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571 Feb 27 02:05:07 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:07 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] Deleted volume successfully. Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a76f2f6d-0d52-40d4-9335-f1c6b294514f tempest-VolumesTransfersTest-662214529 None] Lock "cinder-839b77f2-fcdf-44ee-8537-160eff04655b-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:07 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_5xm7jy_jdevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 was qcow2, converting to raw {{(pid=83231) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_5xm7jy_jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:07 devstack sudo[86766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_5xm7jy_jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a Feb 27 02:05:07 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:07 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_0agl_174devstack@QuobyteHD /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23" returned: 0 in 1.393s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_0agl_174devstack@QuobyteHD, size 112.00 MB, duration 1.39 sec, destination /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 {{(pid=83231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:05:07 devstack cinder-volume[83231]: INFO cinder.image.image_utils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Converted 112.00 MB image at 80.30 MB/s Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:07 devstack sudo[86768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 1G Feb 27 02:05:07 devstack sudo[86768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Flow 'volume_create_manager' (25ecd180-1961-4166-97c3-e191d7c9c16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53074432-e879-4798-b6a7-d54b733cc752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53074432-e879-4798-b6a7-d54b733cc752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-419434343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bce2afe-83a4-416a-b0a1-96f07fcf034a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ad4b1d2c284805b0c298233bfc2597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:07Z,use_quota=True,user_id='5b060b7fbf60460087833b0eb61eb9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3a0208-4136-48b3-8b6c-c5270d951cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3a0208-4136-48b3-8b6c-c5270d951cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c690b4f-89a6-4838-9e99-7cf284e51c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c690b4f-89a6-4838-9e99-7cf284e51c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bce2afe-83a4-416a-b0a1-96f07fcf034a', 'volume_name': 'volume-6bce2afe-83a4-416a-b0a1-96f07fcf034a', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f5c6bf-18df-48b4-94fa-fa566970f0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f5c6bf-18df-48b4-94fa-fa566970f0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (728076fe-3b17-47bb-9af0-c29cbcf10b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:07 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Volume 6bce2afe-83a4-416a-b0a1-96f07fcf034a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bce2afe-83a4-416a-b0a1-96f07fcf034a', 'volume_size': 1} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-419434343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bce2afe-83a4-416a-b0a1-96f07fcf034a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ad4b1d2c284805b0c298233bfc2597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:07Z,use_quota=True,user_id='5b060b7fbf60460087833b0eb61eb9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Creating volume 6bce2afe-83a4-416a-b0a1-96f07fcf034a {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:07 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6bce2afe-83a4-416a-b0a1-96f07fcf034a 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:07 devstack sudo[86771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6bce2afe-83a4-416a-b0a1-96f07fcf034a 1073741824 Feb 27 02:05:07 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:07 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22.e89d80b7-a813-48b6-b6b1-751b3fa96571" returned: 0 in 0.577s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-e89d80b7-a813-48b6-b6b1-751b3fa96571" released by "_delete_snapshot" :: held 3.062s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-8ea2cb3e-f763-45db-afce-40327f614c22" released by "delete_snapshot" :: held 3.088s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:07 devstack cinder-volume[83231]: WARNING cinder.quota [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-295297100 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-295297100, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:07 devstack cinder-volume[83231]: WARNING cinder.quota [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-295297100 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-295297100, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Created reservations ['d6db07c5-502c-46d5-8762-c4322632e0e3', 'e808bf4a-a10b-4124-b276-eb1efd90172c', 'c08fc3b7-9da3-41cd-8fd0-19052bd9be29', '90d0a3ec-31de-4054-a46f-57da7a885e2f'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:07 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] Created reservations ['d7df275e-f1e4-4024-810e-92d77a966d3e', '67395b38-4173-421f-af11-453401bf62db', '286dba7b-9fcb-4f4b-94b6-bbea090e246b', 'bba2e421-6ac7-4689-95c7-36cc6d6647dd'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:07 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-26f0d164-6cb0-461f-aaf1-a2fac65b639d tempest-GroupSnapshotsTest-1276894660 None] group_snapshot 19676d73-1cdf-4437-ad77-8bd9cf399282: deleted successfully Feb 27 02:05:08 devstack sudo[86768]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 1G" returned: 0 in 0.724s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[058f0422-d843-4ea2-a6ec-2d3bae2ded6f]: (4, 'raw') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:08 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6bce2afe-83a4-416a-b0a1-96f07fcf034a 1073741824" returned: 0 in 0.685s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6bce2afe-83a4-416a-b0a1-96f07fcf034a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:08 devstack sudo[86791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6bce2afe-83a4-416a-b0a1-96f07fcf034a Feb 27 02:05:08 devstack sudo[86791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:08 devstack sudo[86790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 Feb 27 02:05:08 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "cinder-quobyte-2abe3f4b-5293-479c-90ab-a096a89bcb22" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-2abe3f4b-5293-479c-90ab-a096a89bcb22" acquired by "delete_volume" :: waited 0.015s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f423e3aa-bb94-4402-9fb7-eaa58ecf6144]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:08 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_5xm7jy_jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a" returned: 0 in 1.391s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_5xm7jy_jdevstack@QuobyteHD, size 112.00 MB, duration 1.39 sec, destination /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a {{(pid=83231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:05:08 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Converted 112.00 MB image at 80.44 MB/s Feb 27 02:05:08 devstack sudo[86794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22 Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:08 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:08 devstack sudo[86796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a 1G Feb 27 02:05:08 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:08 devstack sudo[86791]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6bce2afe-83a4-416a-b0a1-96f07fcf034a" returned: 0 in 0.536s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (728076fe-3b17-47bb-9af0-c29cbcf10b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bce2afe-83a4-416a-b0a1-96f07fcf034a', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a408293-10ce-4deb-9729-0bde87df3826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:08 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Volume volume-6bce2afe-83a4-416a-b0a1-96f07fcf034a (6bce2afe-83a4-416a-b0a1-96f07fcf034a): created successfully Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a408293-10ce-4deb-9729-0bde87df3826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Flow 'volume_create_manager' (25ecd180-1961-4166-97c3-e191d7c9c16e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:08 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-0ffce8aa-cbb2-450a-b9ba-8f44cfddeec2 tempest-VolumesTransfersTest-920993639 None] Created volume successfully. Feb 27 02:05:08 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23" returned: 0 in 0.663s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:08 devstack sudo[86801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 Feb 27 02:05:08 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:09 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22" returned: 0 in 0.582s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:09 devstack sudo[86809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22 Feb 27 02:05:09 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:09 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a 1G" returned: 0 in 0.572s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a573bda4-c3ff-4c34-b580-ca49c4ff9f59]: (4, 'raw') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:09 devstack sudo[86811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a Feb 27 02:05:09 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:09 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23" returned: 1 in 0.638s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23' failed. Not Retrying. {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG cinder.volume.volume_utils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Downloaded image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}])) to volume 2c6d27b0-cd96-45d7-a60c-22aeb786db23 successfully. {{(pid=83231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Temporary image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 for user 1414300d454a4d4e8c20ee14fdb6138f is deleted. {{(pid=83231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG cinder.volume.volume_utils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Marking volume 2c6d27b0-cd96-45d7-a60c-22aeb786db23 as bootable. {{(pid=83231) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Copying metadata from image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 to 2c6d27b0-cd96-45d7-a60c-22aeb786db23. {{(pid=83231) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Creating volume glance metadata for volume 2c6d27b0-cd96-45d7-a60c-22aeb786db23 backed by image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83231) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f3ad56-c02c-4b0b-9831-2143b0dc837a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23', 'volume_size': 1, 'image_id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '264ceeea24524ec49624b8e3d37f06d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b8e226-1ae0-4437-a87b-2042c1f23f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:09 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Volume volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 (2c6d27b0-cd96-45d7-a60c-22aeb786db23): created successfully Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b8e226-1ae0-4437-a87b-2042c1f23f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Flow 'volume_create_manager' (f6b2b97f-f80c-4b09-9e6b-88b9b7a5a1a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:09 devstack cinder-volume[83231]: INFO cinder.volume.manager [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-b939c1bd-6335-4f97-a6eb-455cc8e7d1c8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Created volume successfully. Feb 27 02:05:09 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2abe3f4b-5293-479c-90ab-a096a89bcb22" returned: 0 in 0.668s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-2abe3f4b-5293-479c-90ab-a096a89bcb22" released by "delete_volume" :: held 1.309s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "cinder-quobyte-8ea2cb3e-f763-45db-afce-40327f614c22" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-8ea2cb3e-f763-45db-afce-40327f614c22" acquired by "delete_volume" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cc08bd-824b-4699-911b-cf75c1e249d6]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:09 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] Acquiring lock "cinder-6bce2afe-83a4-416a-b0a1-96f07fcf034a-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a" returned: 0 in 0.679s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:09 devstack sudo[86819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22 Feb 27 02:05:09 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:09 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] Lock "cinder-6bce2afe-83a4-416a-b0a1-96f07fcf034a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:10 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] Acquiring lock "cinder-quobyte-6bce2afe-83a4-416a-b0a1-96f07fcf034a" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:10 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] Lock "cinder-quobyte-6bce2afe-83a4-416a-b0a1-96f07fcf034a" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:10 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d301b7-f434-45f3-9a05-2b5db745aaca]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6bce2afe-83a4-416a-b0a1-96f07fcf034a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:10 devstack sudo[86820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a Feb 27 02:05:10 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:10 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6bce2afe-83a4-416a-b0a1-96f07fcf034a Feb 27 02:05:10 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:10 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22" returned: 0 in 0.616s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:10 devstack sudo[86831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22 Feb 27 02:05:10 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:10 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a" returned: 1 in 0.625s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a' failed. Not Retrying. {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:05:10 devstack cinder-volume[83231]: DEBUG cinder.volume.volume_utils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Downloaded image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}])) to volume bad5b0c8-941a-41b6-8dfd-702b4c2c265a successfully. {{(pid=83231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:05:10 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Temporary image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 for user 6e7d9b054d824b0c932d7894b36ea285 is deleted. {{(pid=83231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:05:10 devstack cinder-volume[83231]: DEBUG cinder.volume.volume_utils [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Marking volume bad5b0c8-941a-41b6-8dfd-702b4c2c265a as bootable. {{(pid=83231) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:05:10 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Copying metadata from image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 to bad5b0c8-941a-41b6-8dfd-702b4c2c265a. {{(pid=83231) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:05:10 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Creating volume glance metadata for volume bad5b0c8-941a-41b6-8dfd-702b4c2c265a backed by image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83231) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:05:10 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6bce2afe-83a4-416a-b0a1-96f07fcf034a" returned: 0 in 0.630s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6bce2afe-83a4-416a-b0a1-96f07fcf034a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:10 devstack sudo[86836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6bce2afe-83a4-416a-b0a1-96f07fcf034a Feb 27 02:05:10 devstack sudo[86836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:10 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc91a6d-715c-422f-80f3-52f0a2140ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a', 'volume_size': 1, 'image_id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '264ceeea24524ec49624b8e3d37f06d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:10 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba335333-83b8-4b50-92c7-3f9256af9cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:10 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Volume volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a (bad5b0c8-941a-41b6-8dfd-702b4c2c265a): created successfully Feb 27 02:05:10 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba335333-83b8-4b50-92c7-3f9256af9cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:10 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Flow 'volume_create_manager' (bebd052c-6174-4a0b-88b1-75f18b28f624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:10 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-4bfc5cbb-3683-46e2-bfa9-366774d4a911 tempest-VolumesImageMetadata-16610418 None] Created volume successfully. Feb 27 02:05:11 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ea2cb3e-f763-45db-afce-40327f614c22" returned: 0 in 0.586s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-8ea2cb3e-f763-45db-afce-40327f614c22" released by "delete_volume" :: held 1.240s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Created reservations ['7a8840f4-531d-480a-9009-dd2ae626a1a5'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:11 devstack cinder-volume[83231]: WARNING cinder.quota [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-295297100 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-295297100, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Created reservations ['3856af64-07f1-44e1-8426-faba4f326edc', 'c1de2fbe-a607-4022-b9df-38b9546b9f91', '0a866c80-2e6e-4e7c-a11d-b90955837421', 'aedee4ba-5475-4383-89c6-edaea393b8fe'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:11 devstack sudo[86836]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6bce2afe-83a4-416a-b0a1-96f07fcf034a" returned: 0 in 0.535s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] Lock "cinder-quobyte-6bce2afe-83a4-416a-b0a1-96f07fcf034a" released by "delete_volume" :: held 1.196s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] Created reservations ['1889e57f-2fd2-41ff-8090-68cfeb46adec', '2ca7651e-51ba-487a-8472-fe1bfebaac00', 'e8cba65b-b34d-46aa-853c-4078595bf4c3', 'a405cc6e-d11e-4d9d-8ae6-fbbd1935bf28'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:11 devstack sudo[86840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:05:11 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Created reservations ['6312080f-9f49-465a-b7d9-c193585adfae', '70fbb632-fff8-4c0a-8463-a0f3e85b1f81', 'c2fce200-46b8-4f51-ab50-8e2e352713a0', 'ba639cc6-2d5f-42ed-9724-6a0a4d5a32a7'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] Acquiring lock "cinder-bad5b0c8-941a-41b6-8dfd-702b4c2c265a-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] Lock "cinder-bad5b0c8-941a-41b6-8dfd-702b4c2c265a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:11 devstack sudo[86842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:05:11 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] Acquiring lock "cinder-quobyte-bad5b0c8-941a-41b6-8dfd-702b4c2c265a" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] Lock "cinder-quobyte-bad5b0c8-941a-41b6-8dfd-702b4c2c265a" acquired by "delete_volume" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d6e49b-1e2c-483c-aa73-fed22cfbe820]: (4, 'raw') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:11 devstack sudo[86844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a Feb 27 02:05:11 devstack sudo[86844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-3a1a543a-92ab-47a9-b3eb-6802a9a5269f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-3a1a543a-92ab-47a9-b3eb-6802a9a5269f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:12 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3834ce-e59a-4f47-9048-42ecc486b7ae]: (4, 'raw') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-3a1a543a-92ab-47a9-b3eb-6802a9a5269f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:12 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.773s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:12 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:12 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] Deleted volume successfully. Feb 27 02:05:12 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b2951c76-e9fc-43f5-9a0c-e3f5fa8c6ac8 tempest-VolumesTransfersTest-662214529 None] Lock "cinder-6bce2afe-83a4-416a-b0a1-96f07fcf034a-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:12 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.669s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:12 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:12 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-27473460-bbe7-4090-ba69-ac4487a58916 tempest-GroupSnapshotsTest-1276894660 None] Delete group completed successfully. Feb 27 02:05:12 devstack sudo[86855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 Feb 27 02:05:12 devstack sudo[86855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:12 devstack sudo[86844]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a" returned: 0 in 0.755s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:12 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-734f04b3-24eb-4370-bf6a-9df2b3012b49 tempest-GroupSnapshotsTest-1276894660 None] Group tempest-GroupSnapshotsTest-Group-218769055: creating Feb 27 02:05:12 devstack sudo[86860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a Feb 27 02:05:12 devstack sudo[86860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:12 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-734f04b3-24eb-4370-bf6a-9df2b3012b49 tempest-GroupSnapshotsTest-1276894660 None] Group tempest-GroupSnapshotsTest-Group-218769055: created successfully Feb 27 02:05:12 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-734f04b3-24eb-4370-bf6a-9df2b3012b49 tempest-GroupSnapshotsTest-1276894660 None] Create group completed successfully. Feb 27 02:05:12 devstack sudo[86855]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-3a1a543a-92ab-47a9-b3eb-6802a9a5269f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23" returned: 0 in 0.717s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-3a1a543a-92ab-47a9-b3eb-6802a9a5269f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:12 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 Feb 27 02:05:12 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:13 devstack sudo[86860]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a" returned: 1 in 0.683s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a' failed. Not Retrying. {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:05:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:13 devstack sudo[86870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a Feb 27 02:05:13 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:13 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-3a1a543a-92ab-47a9-b3eb-6802a9a5269f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23" returned: 1 in 0.677s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-3a1a543a-92ab-47a9-b3eb-6802a9a5269f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23' failed. Not Retrying. {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:05:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-3a1a543a-92ab-47a9-b3eb-6802a9a5269f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.442s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-3a1a543a-92ab-47a9-b3eb-6802a9a5269f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa', 'name': 'volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31b44e7e-2bc5-4aab-9d00-2361a83ca9c4', 'enforce_multipath': True} {{(pid=83231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 02:05:13 devstack cinder-volume[83231]: INFO cinder.volume.manager [req-16d7de96-7020-4534-8a86-802dc3a67a8a req-3a1a543a-92ab-47a9-b3eb-6802a9a5269f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] attachment_update completed successfully. Feb 27 02:05:13 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bad5b0c8-941a-41b6-8dfd-702b4c2c265a" returned: 0 in 0.724s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:13 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] Lock "cinder-quobyte-bad5b0c8-941a-41b6-8dfd-702b4c2c265a" released by "delete_volume" :: held 2.214s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:13 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] Created reservations ['63d7ab8b-d4bf-4477-9f9c-fe152271e2b4', '01ec5209-1a41-4bac-b554-1a41a9cabcb2', '29750b85-dcf5-4e95-9b9c-cad5fea6a3b8', '1374638c-3f53-4897-b468-72bfd60206d3'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:13 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:13 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:14 devstack sudo[86882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:05:14 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Flow 'volume_create_manager' (7415f278-0c40-4bba-bcb0-e462deab6a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b60660d-eceb-4d72-af7a-97848a40fc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b60660d-eceb-4d72-af7a-97848a40fc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1158339588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1f166ecc-66f9-4fa1-a4a3-e0ab20130de0,host='devstack@QuobyteHD#QuobyteHD',id=f61a0ff6-4ce9-4fe1-b315-446dde142bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb0e94ee39d49c9ad5bdeeb02f6f944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:14Z,use_quota=True,user_id='2ea39432d49b4b97b25de35a72f6f0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db52a928-7d47-47a7-bc93-96cd1611a13b),volume_type_id=db52a928-7d47-47a7-bc93-96cd1611a13b)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17bcea9-41cb-469a-b890-8a71ccccc1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17bcea9-41cb-469a-b890-8a71ccccc1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350055ba-4819-461f-9f2a-cecb59f36ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350055ba-4819-461f-9f2a-cecb59f36ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f61a0ff6-4ce9-4fe1-b315-446dde142bd8', 'volume_name': 'volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba3776e-dc28-481e-801c-126f7409fe45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba3776e-dc28-481e-801c-126f7409fe45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da06dd14-1f69-476b-8317-decaf6c9176f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:14 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Volume f61a0ff6-4ce9-4fe1-b315-446dde142bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8', 'volume_size': 1} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1f166ecc-66f9-4fa1-a4a3-e0ab20130de0,created_at=2026-02-27T01:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1158339588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1f166ecc-66f9-4fa1-a4a3-e0ab20130de0,host='devstack@QuobyteHD#QuobyteHD',id=f61a0ff6-4ce9-4fe1-b315-446dde142bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb0e94ee39d49c9ad5bdeeb02f6f944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:14Z,use_quota=True,user_id='2ea39432d49b4b97b25de35a72f6f0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db52a928-7d47-47a7-bc93-96cd1611a13b),volume_type_id=db52a928-7d47-47a7-bc93-96cd1611a13b)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Creating volume f61a0ff6-4ce9-4fe1-b315-446dde142bd8 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:14 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:14 devstack sudo[86884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8 1073741824 Feb 27 02:05:14 devstack sudo[86884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:14 devstack sudo[86884]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8 1073741824" returned: 0 in 0.816s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:14 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 1.005s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:14 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:15 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] Deleted volume successfully. Feb 27 02:05:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:15 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-22cdbf8c-74da-4708-9b2c-3525128e70e5 tempest-VolumesImageMetadata-16610418 None] Lock "cinder-bad5b0c8-941a-41b6-8dfd-702b4c2c265a-delete_volume" released by "delete_volume" :: held 3.525s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:15 devstack sudo[86890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8 Feb 27 02:05:15 devstack sudo[86890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:15 devstack sudo[86890]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8" returned: 0 in 0.718s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da06dd14-1f69-476b-8317-decaf6c9176f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48cbc6c8-0afb-454f-8c97-39df69b6206a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:15 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Volume volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8 (f61a0ff6-4ce9-4fe1-b315-446dde142bd8): created successfully Feb 27 02:05:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48cbc6c8-0afb-454f-8c97-39df69b6206a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Flow 'volume_create_manager' (7415f278-0c40-4bba-bcb0-e462deab6a2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:15 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-c5253448-8584-4a94-90ad-2dd8ca03887b tempest-GroupSnapshotsTest-1276894660 None] Created volume successfully. Feb 27 02:05:16 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] GroupSnapshot 7a09bee9-2d23-4b14-8069-78b3bef2e8d0: creating. Feb 27 02:05:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] Group snapshot 7a09bee9-2d23-4b14-8069-78b3bef2e8d0: creating. {{(pid=83231) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:05:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] Creating offline snapshot b65ce4e6-4151-4a3a-a5d1-520cb925142e of volume f61a0ff6-4ce9-4fe1-b315-446dde142bd8 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:05:16 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[756665cc-eb5e-4735-8ac9-8abf2891f8b6]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:16 devstack sudo[86893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8 Feb 27 02:05:16 devstack sudo[86893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:17 devstack sudo[86893]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8" returned: 0 in 0.677s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:17 devstack sudo[86901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e 1G Feb 27 02:05:17 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:17 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e 1G" returned: 0 in 0.825s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:18 devstack sudo[86906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e Feb 27 02:05:18 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:19 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e" returned: 0 in 1.096s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:19 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:05:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:19 devstack sudo[86935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e Feb 27 02:05:19 devstack sudo[86935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:19 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Flow 'volume_create_manager' (43e1348e-0d3a-4ac9-a6b7-08c4b20ce1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80decf6-8501-4046-a17b-49280d0581db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80decf6-8501-4046-a17b-49280d0581db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1633013466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7833fd07-b31a-4a2a-8f73-6ff0d286156b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0f57b82e8439985ede746f37ae2d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:20Z,use_quota=True,user_id='1606b9a374874c3fbd1abbe115829446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba1e5df-d450-4670-877b-23f9e53d4ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba1e5df-d450-4670-877b-23f9e53d4ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814cba39-ab3c-4b31-b07c-fb9e668299a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814cba39-ab3c-4b31-b07c-fb9e668299a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7833fd07-b31a-4a2a-8f73-6ff0d286156b', 'volume_name': 'volume-7833fd07-b31a-4a2a-8f73-6ff0d286156b', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:20 devstack sudo[86935]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683d9c90-1593-4e6d-a3f2-d0be305b27cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683d9c90-1593-4e6d-a3f2-d0be305b27cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cec64f-91c9-4b3f-9756-5e5c4a67ed79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:20 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Volume 7833fd07-b31a-4a2a-8f73-6ff0d286156b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7833fd07-b31a-4a2a-8f73-6ff0d286156b', 'volume_size': 1} Feb 27 02:05:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e" returned: 0 in 1.103s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:20 devstack sudo[86973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.info Feb 27 02:05:20 devstack sudo[86973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:21 devstack sudo[86973]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.info" returned: 0 in 0.884s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:21 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:21 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.info Feb 27 02:05:21 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Flow 'volume_create_manager' (abd5fe37-16ad-41a0-b012-8677ad6c6f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5db147-d3b6-4fcd-a302-6ffda88f2742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5db147-d3b6-4fcd-a302-6ffda88f2742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2077717032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d82804eb6104812bd15d3a1d89b824c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:21Z,use_quota=True,user_id='9a4fbfe383f94c3386684725f093e65c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90bc90df-d0a3-45e7-93ed-a7d4b32ae3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90bc90df-d0a3-45e7-93ed-a7d4b32ae3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1501b7ba-68d8-441e-9385-3765c03b3c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1501b7ba-68d8-441e-9385-3765c03b3c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf', 'volume_name': 'volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3d93e6-6518-44f9-915f-e744586b7418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3d93e6-6518-44f9-915f-e744586b7418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682f8c8c-bfb5-494e-9254-cfab4e8af1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:21 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Volume d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf', 'volume_size': 1} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:21 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.info" returned: 0 in 0.686s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.386s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.631s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1633013466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7833fd07-b31a-4a2a-8f73-6ff0d286156b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0f57b82e8439985ede746f37ae2d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:20Z,use_quota=True,user_id='1606b9a374874c3fbd1abbe115829446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Creating volume 7833fd07-b31a-4a2a-8f73-6ff0d286156b {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:21 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:05:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7833fd07-b31a-4a2a-8f73-6ff0d286156b 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:21 devstack sudo[86979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7833fd07-b31a-4a2a-8f73-6ff0d286156b 1073741824 Feb 27 02:05:21 devstack sudo[86979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:21 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-fecb19f1-7de1-43e0-95c1-65f0931a3d02 tempest-GroupSnapshotsTest-1276894660 None] group_snapshot 7a09bee9-2d23-4b14-8069-78b3bef2e8d0: created successfully Feb 27 02:05:22 devstack sudo[86979]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7833fd07-b31a-4a2a-8f73-6ff0d286156b 1073741824" returned: 0 in 0.620s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7833fd07-b31a-4a2a-8f73-6ff0d286156b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:22 devstack sudo[86984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7833fd07-b31a-4a2a-8f73-6ff0d286156b Feb 27 02:05:22 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:22 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] group_snapshot 7a09bee9-2d23-4b14-8069-78b3bef2e8d0: deleting Feb 27 02:05:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] group_snapshot 7a09bee9-2d23-4b14-8069-78b3bef2e8d0: deleting {{(pid=83231) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:05:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "cinder-quobyte-f61a0ff6-4ce9-4fe1-b315-446dde142bd8" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-f61a0ff6-4ce9-4fe1-b315-446dde142bd8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "cinder-quobyte-b65ce4e6-4151-4a3a-a5d1-520cb925142e" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-b65ce4e6-4151-4a3a-a5d1-520cb925142e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] Deleting offline snapshot b65ce4e6-4151-4a3a-a5d1-520cb925142e of volume f61a0ff6-4ce9-4fe1-b315-446dde142bd8 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:05:23 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] snapshot_file for this snap is: volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7833fd07-b31a-4a2a-8f73-6ff0d286156b" returned: 0 in 0.575s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc03997-c381-46f8-9237-dd6525e17a6b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.482s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2077717032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d82804eb6104812bd15d3a1d89b824c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:21Z,use_quota=True,user_id='9a4fbfe383f94c3386684725f093e65c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Creating volume d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:23 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:23 devstack sudo[86988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf 1073741824 Feb 27 02:05:23 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cec64f-91c9-4b3f-9756-5e5c4a67ed79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7833fd07-b31a-4a2a-8f73-6ff0d286156b', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766db436-92ca-4768-8497-758d726e195f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:23 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Volume volume-7833fd07-b31a-4a2a-8f73-6ff0d286156b (7833fd07-b31a-4a2a-8f73-6ff0d286156b): created successfully Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766db436-92ca-4768-8497-758d726e195f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Flow 'volume_create_manager' (43e1348e-0d3a-4ac9-a6b7-08c4b20ce1e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:23 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-98f769f4-c2ae-4de4-a35b-49dfd57ff8df tempest-VolumesTransfersV355Test-1208575289 None] Created volume successfully. Feb 27 02:05:23 devstack sudo[86989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e Feb 27 02:05:23 devstack sudo[86989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:23 devstack sudo[86989]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e" returned: 0 in 0.733s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2d01c5-2502-4d27-8b24-60f66c4d6f9d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:23 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf 1073741824" returned: 0 in 0.803s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:23 devstack sudo[86999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf Feb 27 02:05:23 devstack sudo[86999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:23 devstack sudo[86998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8 Feb 27 02:05:23 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:24 devstack sudo[86999]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf" returned: 0 in 0.480s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:24 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:24 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682f8c8c-bfb5-494e-9254-cfab4e8af1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:24 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc5fdacf-43fe-468c-8e62-5fe448e84593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:24 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Volume volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf (d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf): created successfully Feb 27 02:05:24 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc5fdacf-43fe-468c-8e62-5fe448e84593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:24 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Flow 'volume_create_manager' (abd5fe37-16ad-41a0-b012-8677ad6c6f3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:24 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b3a3e715-016d-410a-83a4-7d3ae96ca3ea tempest-VolumesDeleteCascade-1242545037 None] Created volume successfully. Feb 27 02:05:24 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8" returned: 0 in 0.640s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:24 devstack sudo[87006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e Feb 27 02:05:24 devstack sudo[87006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:24 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b66eb698-b18e-4cf8-9db4-70dc670cbff9 tempest-VolumesTransfersV355Test-1184100253 None] Transfer volume completed successfully. Feb 27 02:05:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9308b118-680f-49b6-aa9f-60a5503dec22 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9308b118-680f-49b6-aa9f-60a5503dec22 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:24 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-9308b118-680f-49b6-aa9f-60a5503dec22 tempest-VolumesDeleteCascade-1242545037 None] Creating offline snapshot 8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 of volume d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:05:24 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad663de-42d6-4b70-9409-600d0d07aa8f]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9308b118-680f-49b6-aa9f-60a5503dec22 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:25 devstack sudo[87008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf Feb 27 02:05:25 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:25 devstack sudo[87006]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e" returned: 0 in 0.690s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:25 devstack sudo[87013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e Feb 27 02:05:25 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:25 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9308b118-680f-49b6-aa9f-60a5503dec22 tempest-VolumesDeleteCascade-1242545037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf" returned: 0 in 0.751s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9308b118-680f-49b6-aa9f-60a5503dec22 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:25 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 1G Feb 27 02:05:25 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:26 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8.b65ce4e6-4151-4a3a-a5d1-520cb925142e" returned: 0 in 0.877s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-b65ce4e6-4151-4a3a-a5d1-520cb925142e" released by "_delete_snapshot" :: held 3.089s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-f61a0ff6-4ce9-4fe1-b315-446dde142bd8" released by "delete_snapshot" :: held 3.112s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] Acquiring lock "cinder-7833fd07-b31a-4a2a-8f73-6ff0d286156b-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] Lock "cinder-7833fd07-b31a-4a2a-8f73-6ff0d286156b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] Acquiring lock "cinder-quobyte-7833fd07-b31a-4a2a-8f73-6ff0d286156b" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:26 devstack cinder-volume[83231]: WARNING cinder.quota [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1942522732 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1942522732, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:26 devstack cinder-volume[83231]: WARNING cinder.quota [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1942522732 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1942522732, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] Lock "cinder-quobyte-7833fd07-b31a-4a2a-8f73-6ff0d286156b" acquired by "delete_volume" :: waited 0.021s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:26 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cd59fc-e480-4c72-abc4-2e0fe0514df0]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7833fd07-b31a-4a2a-8f73-6ff0d286156b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:26 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] Created reservations ['31628cbd-d278-4bb0-b0a4-9ca9e30899a3', '1b32cdfc-972e-436a-858c-8778d486155a', '87b7a2f0-f636-4255-acda-0ad0c1ce8c02', '3c8ac6c1-797f-4e43-b017-f009feff5e86'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:26 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-bf72f2e3-2dcd-4260-ae23-bc37b1594d22 tempest-GroupSnapshotsTest-1276894660 None] group_snapshot 7a09bee9-2d23-4b14-8069-78b3bef2e8d0: deleted successfully Feb 27 02:05:26 devstack sudo[87045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7833fd07-b31a-4a2a-8f73-6ff0d286156b Feb 27 02:05:26 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:26 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9308b118-680f-49b6-aa9f-60a5503dec22 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 1G" returned: 0 in 0.831s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9308b118-680f-49b6-aa9f-60a5503dec22 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:26 devstack sudo[87050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 Feb 27 02:05:26 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:26 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7833fd07-b31a-4a2a-8f73-6ff0d286156b" returned: 0 in 0.710s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7833fd07-b31a-4a2a-8f73-6ff0d286156b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:27 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7833fd07-b31a-4a2a-8f73-6ff0d286156b Feb 27 02:05:27 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:27 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9308b118-680f-49b6-aa9f-60a5503dec22 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76" returned: 0 in 0.559s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:27 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-9308b118-680f-49b6-aa9f-60a5503dec22 tempest-VolumesDeleteCascade-1242545037 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 is being set with open permissions: ugo+rw Feb 27 02:05:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9308b118-680f-49b6-aa9f-60a5503dec22 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:27 devstack sudo[87060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 Feb 27 02:05:27 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-eb289fd9-ca6b-4de9-8398-532373187997 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "cinder-quobyte-f61a0ff6-4ce9-4fe1-b315-446dde142bd8" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:27 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-eb289fd9-ca6b-4de9-8398-532373187997 tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-f61a0ff6-4ce9-4fe1-b315-446dde142bd8" acquired by "delete_volume" :: waited 0.016s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7833fd07-b31a-4a2a-8f73-6ff0d286156b" returned: 0 in 0.653s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:27 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[27395905-aa0f-4eed-be6c-ed6bdebd390d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-eb289fd9-ca6b-4de9-8398-532373187997 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] Lock "cinder-quobyte-7833fd07-b31a-4a2a-8f73-6ff0d286156b" released by "delete_volume" :: held 1.416s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:27 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9308b118-680f-49b6-aa9f-60a5503dec22 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76" returned: 0 in 0.618s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:27 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] Created reservations ['bbcc0e11-99c0-46c2-89c3-768f8288c8b0', 'a1a785d8-50ea-4ee9-87d3-9ffa0d262a1c', '25974596-a8d1-4f70-8ea2-19a68d4d7b0c', '1e90d77b-62c8-4f3f-a983-9f00bbac9768'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9308b118-680f-49b6-aa9f-60a5503dec22 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:27 devstack sudo[87077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.info Feb 27 02:05:27 devstack sudo[87074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8 Feb 27 02:05:27 devstack sudo[87077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:27 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:27 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:27 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:27 devstack sudo[87083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:05:27 devstack sudo[87083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:28 devstack sudo[87077]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9308b118-680f-49b6-aa9f-60a5503dec22 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.info" returned: 0 in 0.536s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:28 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-9308b118-680f-49b6-aa9f-60a5503dec22 tempest-VolumesDeleteCascade-1242545037 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.info is being set with open permissions: ugo+rw Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9308b118-680f-49b6-aa9f-60a5503dec22 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:28 devstack sudo[87090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.info Feb 27 02:05:28 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:28 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-eb289fd9-ca6b-4de9-8398-532373187997 tempest-GroupSnapshotsTest-1276894660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8" returned: 0 in 0.723s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:28 devstack sudo[87083]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-eb289fd9-ca6b-4de9-8398-532373187997 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.539s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:28 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] Deleted volume successfully. Feb 27 02:05:28 devstack sudo[87092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8 Feb 27 02:05:28 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-22318ab1-4fde-4df9-987a-6ea1224c2d1d tempest-VolumesTransfersV355Test-1945986791 None] Lock "cinder-7833fd07-b31a-4a2a-8f73-6ff0d286156b-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:28 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Flow 'volume_create_manager' (dba6aa89-7d04-40df-bb99-158ebb966d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b72ee7b-bf36-4adc-9d09-e8ceb4a16b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b72ee7b-bf36-4adc-9d09-e8ceb4a16b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-182118820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245d09ba-658e-45bd-af62-a852913f4157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0f57b82e8439985ede746f37ae2d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:29Z,use_quota=True,user_id='1606b9a374874c3fbd1abbe115829446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d93068-0ff5-4661-aa6d-3d18766eba38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d93068-0ff5-4661-aa6d-3d18766eba38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f667ecd4-beb4-4569-b622-7005a4781190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f667ecd4-beb4-4569-b622-7005a4781190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '245d09ba-658e-45bd-af62-a852913f4157', 'volume_name': 'volume-245d09ba-658e-45bd-af62-a852913f4157', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0507b1-eae1-4f96-a8f1-34397f50ecd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0507b1-eae1-4f96-a8f1-34397f50ecd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d56fcbf-c299-455b-964b-a75db989a021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:28 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Volume 245d09ba-658e-45bd-af62-a852913f4157: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-245d09ba-658e-45bd-af62-a852913f4157', 'volume_size': 1} Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9308b118-680f-49b6-aa9f-60a5503dec22 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.info" returned: 0 in 0.669s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9308b118-680f-49b6-aa9f-60a5503dec22 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.065s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.023s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:28 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-182118820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245d09ba-658e-45bd-af62-a852913f4157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d0f57b82e8439985ede746f37ae2d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:29Z,use_quota=True,user_id='1606b9a374874c3fbd1abbe115829446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Creating volume 245d09ba-658e-45bd-af62-a852913f4157 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:29 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-245d09ba-658e-45bd-af62-a852913f4157 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:29 devstack sudo[87096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-245d09ba-658e-45bd-af62-a852913f4157 1073741824 Feb 27 02:05:29 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:29 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-9308b118-680f-49b6-aa9f-60a5503dec22 tempest-VolumesDeleteCascade-1242545037 None] Create snapshot completed successfully Feb 27 02:05:29 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-eb289fd9-ca6b-4de9-8398-532373187997 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f61a0ff6-4ce9-4fe1-b315-446dde142bd8" returned: 0 in 0.701s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-eb289fd9-ca6b-4de9-8398-532373187997 tempest-GroupSnapshotsTest-1276894660 None] Lock "cinder-quobyte-f61a0ff6-4ce9-4fe1-b315-446dde142bd8" released by "delete_volume" :: held 1.474s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-eb289fd9-ca6b-4de9-8398-532373187997 tempest-GroupSnapshotsTest-1276894660 None] Created reservations ['838dd07c-4e67-469c-b64e-82cf3f3acfaf'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:29 devstack cinder-volume[83231]: WARNING cinder.quota [None req-eb289fd9-ca6b-4de9-8398-532373187997 tempest-GroupSnapshotsTest-1276894660 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1942522732 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1942522732, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-eb289fd9-ca6b-4de9-8398-532373187997 tempest-GroupSnapshotsTest-1276894660 None] Created reservations ['0ddf5b89-80da-4923-8afa-af0d865e4e7d', 'de4a68e7-f80f-4f25-b177-418065e1b8f3', '0b170fd4-8138-4bec-b68a-3ae54f9e3740', 'a5733d33-15e6-46d0-84f0-85bf474e4bd6'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-eb289fd9-ca6b-4de9-8398-532373187997 tempest-GroupSnapshotsTest-1276894660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-eb289fd9-ca6b-4de9-8398-532373187997 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-eb289fd9-ca6b-4de9-8398-532373187997 tempest-GroupSnapshotsTest-1276894660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-eb289fd9-ca6b-4de9-8398-532373187997 tempest-GroupSnapshotsTest-1276894660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-eb289fd9-ca6b-4de9-8398-532373187997 tempest-GroupSnapshotsTest-1276894660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-eb289fd9-ca6b-4de9-8398-532373187997 tempest-GroupSnapshotsTest-1276894660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:29 devstack sudo[87098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:05:29 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f9f3cbaa-4daa-4fe7-8904-74190016b5be tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:29 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-245d09ba-658e-45bd-af62-a852913f4157 1073741824" returned: 0 in 0.672s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-245d09ba-658e-45bd-af62-a852913f4157 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:29 devstack sudo[87104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-245d09ba-658e-45bd-af62-a852913f4157 Feb 27 02:05:29 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:29 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-eb289fd9-ca6b-4de9-8398-532373187997 tempest-GroupSnapshotsTest-1276894660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.640s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:29 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-eb289fd9-ca6b-4de9-8398-532373187997 tempest-GroupSnapshotsTest-1276894660 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:29 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-eb289fd9-ca6b-4de9-8398-532373187997 tempest-GroupSnapshotsTest-1276894660 None] Delete group completed successfully. Feb 27 02:05:30 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-245d09ba-658e-45bd-af62-a852913f4157" returned: 0 in 0.576s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f9f3cbaa-4daa-4fe7-8904-74190016b5be tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.904s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:30 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d56fcbf-c299-455b-964b-a75db989a021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-245d09ba-658e-45bd-af62-a852913f4157', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:30 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d605af7-e75f-48e2-b236-f0e6f7fcca10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-f9f3cbaa-4daa-4fe7-8904-74190016b5be tempest-VolumesDeleteCascade-1242545037 None] Creating offline snapshot fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 of volume d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:05:30 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Volume volume-245d09ba-658e-45bd-af62-a852913f4157 (245d09ba-658e-45bd-af62-a852913f4157): created successfully Feb 27 02:05:30 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d605af7-e75f-48e2-b236-f0e6f7fcca10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:30 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Flow 'volume_create_manager' (dba6aa89-7d04-40df-bb99-158ebb966d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:30 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[779294f2-86ae-46cb-a1dd-e32aa4aad7a2]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f9f3cbaa-4daa-4fe7-8904-74190016b5be tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:30 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-edc83ab7-a1b8-42b2-aeb9-1921d5689932 tempest-VolumesTransfersV355Test-1208575289 None] Created volume successfully. Feb 27 02:05:30 devstack sudo[87108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 Feb 27 02:05:30 devstack sudo[87108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:31 devstack sudo[87108]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f9f3cbaa-4daa-4fe7-8904-74190016b5be tempest-VolumesDeleteCascade-1242545037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76" returned: 0 in 0.827s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:31 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-f9f3cbaa-4daa-4fe7-8904-74190016b5be tempest-VolumesDeleteCascade-1242545037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f9f3cbaa-4daa-4fe7-8904-74190016b5be tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:31 devstack sudo[87113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 1G Feb 27 02:05:31 devstack sudo[87113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] Acquiring lock "cinder-245d09ba-658e-45bd-af62-a852913f4157-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] Lock "cinder-245d09ba-658e-45bd-af62-a852913f4157-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] Acquiring lock "cinder-quobyte-245d09ba-658e-45bd-af62-a852913f4157" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] Lock "cinder-quobyte-245d09ba-658e-45bd-af62-a852913f4157" acquired by "delete_volume" :: waited 0.017s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:31 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde3d433-d28b-4ebd-81e8-c7bb8affab4b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-245d09ba-658e-45bd-af62-a852913f4157 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:31 devstack sudo[87115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-245d09ba-658e-45bd-af62-a852913f4157 Feb 27 02:05:31 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:32 devstack sudo[87113]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f9f3cbaa-4daa-4fe7-8904-74190016b5be tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 1G" returned: 0 in 0.800s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f9f3cbaa-4daa-4fe7-8904-74190016b5be tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:32 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 Feb 27 02:05:32 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:32 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-245d09ba-658e-45bd-af62-a852913f4157" returned: 0 in 0.760s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-245d09ba-658e-45bd-af62-a852913f4157 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:32 devstack sudo[87150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-245d09ba-658e-45bd-af62-a852913f4157 Feb 27 02:05:32 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:32 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f9f3cbaa-4daa-4fe7-8904-74190016b5be tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89" returned: 0 in 0.776s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:32 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-f9f3cbaa-4daa-4fe7-8904-74190016b5be tempest-VolumesDeleteCascade-1242545037 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 is being set with open permissions: ugo+rw Feb 27 02:05:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f9f3cbaa-4daa-4fe7-8904-74190016b5be tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:32 devstack sudo[87157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 Feb 27 02:05:32 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:33 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-245d09ba-658e-45bd-af62-a852913f4157" returned: 0 in 0.898s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] Lock "cinder-quobyte-245d09ba-658e-45bd-af62-a852913f4157" released by "delete_volume" :: held 1.742s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:33 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] Created reservations ['56a586c2-fab6-4bd6-9601-f1e2618bd711', 'c56b45c0-edb7-4a28-bed5-baf53f73b727', '575d8133-f1cc-49e7-a0f2-36125b1c17a4', '567683f9-40c5-4583-8810-8648650bd2e3'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:33 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:33 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:33 devstack sudo[87162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:05:33 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:33 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f9f3cbaa-4daa-4fe7-8904-74190016b5be tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89" returned: 0 in 0.798s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f9f3cbaa-4daa-4fe7-8904-74190016b5be tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.344s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:33 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-f9f3cbaa-4daa-4fe7-8904-74190016b5be tempest-VolumesDeleteCascade-1242545037 None] Create snapshot completed successfully Feb 27 02:05:34 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.636s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:34 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:34 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] Deleted volume successfully. Feb 27 02:05:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8ec55c18-e9e0-4730-9027-f5749146f2e7 tempest-VolumesTransfersV355Test-1945986791 None] Lock "cinder-245d09ba-658e-45bd-af62-a852913f4157-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "cinder-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Performing cascade delete. {{(pid=83231) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 27 02:05:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "cinder-8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "cinder-quobyte-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "cinder-quobyte-8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:34 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Deleting offline snapshot 8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 of volume d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:05:34 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] snapshot_file for this snap is: volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:05:34 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ae15f5-74f6-4c18-89e3-73ab321ad43d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:34 devstack sudo[87165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 Feb 27 02:05:34 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:35 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76" returned: 0 in 0.648s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:35 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee85d592-1226-4198-a76f-40d9aefc0238]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:35 devstack sudo[87170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf Feb 27 02:05:35 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:35 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-0d0efc44-ed8c-4132-8e25-199eb2d02d56 tempest-GroupsTest-1491450596 None] Group tempest-Group1-1013421003: creating Feb 27 02:05:35 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-0d0efc44-ed8c-4132-8e25-199eb2d02d56 tempest-GroupsTest-1491450596 None] Group tempest-Group1-1013421003: created successfully Feb 27 02:05:35 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-0d0efc44-ed8c-4132-8e25-199eb2d02d56 tempest-GroupsTest-1491450596 None] Create group completed successfully. Feb 27 02:05:36 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf" returned: 0 in 0.831s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:36 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c5c69f-c936-4d79-90d4-4d469c3f3abf]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:36 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 Feb 27 02:05:36 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:37 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89" returned: 0 in 0.604s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:37 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbf7605-5dcb-4055-b09c-aebc55f006c3]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:37 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-d19ff2da-6fa3-4566-a774-ee40cf740c18 tempest-GroupsTest-1491450596 None] Group tempest-Group2-727981157: creating Feb 27 02:05:37 devstack sudo[87180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 Feb 27 02:05:37 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-d19ff2da-6fa3-4566-a774-ee40cf740c18 tempest-GroupsTest-1491450596 None] Group tempest-Group2-727981157: created successfully Feb 27 02:05:37 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:37 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-d19ff2da-6fa3-4566-a774-ee40cf740c18 tempest-GroupsTest-1491450596 None] Create group completed successfully. Feb 27 02:05:37 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76" returned: 0 in 0.796s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:37 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f7973b-66e7-4fab-a875-40b3980b14b1]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:37 devstack sudo[87205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf Feb 27 02:05:37 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:38 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf" returned: 0 in 0.986s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:38 devstack sudo[87231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 Feb 27 02:05:38 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:38 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Flow 'volume_create_manager' (f55f4cd6-977a-4c85-b88e-742c08fbc6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044d777f-50aa-4954-84c8-a3dc512c91ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044d777f-50aa-4954-84c8-a3dc512c91ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-136301709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=954d6223-7ed6-41ec-927e-706feb7fc1b8,host='devstack@QuobyteHD#QuobyteHD',id=8e3db75b-7b6f-46bb-ab7b-6988998427bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6d47e0c9b7044658e6cc5678be6c943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:39Z,use_quota=True,user_id='e34e28720da840a8bb01efbe3c9b40d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(123029a5-38d5-48f6-bcad-a29d65d566e4),volume_type_id=123029a5-38d5-48f6-bcad-a29d65d566e4)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94cb4de-a81a-418e-8101-17bb039ef34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94cb4de-a81a-418e-8101-17bb039ef34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d52685b8-53b2-4b82-a78f-34963180b0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d52685b8-53b2-4b82-a78f-34963180b0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e3db75b-7b6f-46bb-ab7b-6988998427bc', 'volume_name': 'volume-8e3db75b-7b6f-46bb-ab7b-6988998427bc', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2384b2a6-2cd7-4fdd-b55a-fc373425ae7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2384b2a6-2cd7-4fdd-b55a-fc373425ae7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687e5d86-8e43-4ca2-9f82-2fc39e244135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:39 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Volume 8e3db75b-7b6f-46bb-ab7b-6988998427bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e3db75b-7b6f-46bb-ab7b-6988998427bc', 'volume_size': 1} Feb 27 02:05:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=954d6223-7ed6-41ec-927e-706feb7fc1b8,created_at=2026-02-27T01:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-136301709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=954d6223-7ed6-41ec-927e-706feb7fc1b8,host='devstack@QuobyteHD#QuobyteHD',id=8e3db75b-7b6f-46bb-ab7b-6988998427bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6d47e0c9b7044658e6cc5678be6c943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:39Z,use_quota=True,user_id='e34e28720da840a8bb01efbe3c9b40d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(123029a5-38d5-48f6-bcad-a29d65d566e4),volume_type_id=123029a5-38d5-48f6-bcad-a29d65d566e4)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Creating volume 8e3db75b-7b6f-46bb-ab7b-6988998427bc {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:39 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:05:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8e3db75b-7b6f-46bb-ab7b-6988998427bc 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:39 devstack sudo[87234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8e3db75b-7b6f-46bb-ab7b-6988998427bc 1073741824 Feb 27 02:05:39 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:39 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8e3db75b-7b6f-46bb-ab7b-6988998427bc 1073741824" returned: 0 in 0.980s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:40 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76" returned: 0 in 1.254s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8e3db75b-7b6f-46bb-ab7b-6988998427bc {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:40 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76 Feb 27 02:05:40 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:40 devstack sudo[87246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8e3db75b-7b6f-46bb-ab7b-6988998427bc Feb 27 02:05:40 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:41 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76" returned: 0 in 1.041s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 -F qcow2 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:41 devstack sudo[87252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 -F qcow2 Feb 27 02:05:41 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:41 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8e3db75b-7b6f-46bb-ab7b-6988998427bc" returned: 0 in 1.135s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] <== create_volume: return (2255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.259s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:41 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:UPDATE=166,cinder:DELETE=16,cinder:SELECT=161,cinder:INSERT=56 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:05:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687e5d86-8e43-4ca2-9f82-2fc39e244135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e3db75b-7b6f-46bb-ab7b-6988998427bc', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f59fab77-e305-4231-8a87-50eb4162d31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:41 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Volume volume-8e3db75b-7b6f-46bb-ab7b-6988998427bc (8e3db75b-7b6f-46bb-ab7b-6988998427bc): created successfully Feb 27 02:05:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f59fab77-e305-4231-8a87-50eb4162d31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Flow 'volume_create_manager' (f55f4cd6-977a-4c85-b88e-742c08fbc6cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:41 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:UPDATE=180,cinder:INSERT=47,cinder:SELECT=168,cinder:DELETE=6 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:05:41 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-33a984a9-396a-4d7e-a98f-5e69ffac6309 tempest-GroupsTest-1491450596 None] Created volume successfully. Feb 27 02:05:41 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 -F qcow2" returned: 0 in 0.723s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:41 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76" released by "_delete_snapshot" :: held 7.040s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:41 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf" released by "delete_snapshot" :: held 7.055s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:41 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Created reservations ['ff2fdf94-e2f0-4ab6-a083-1b3dfbf29d88', 'e491639d-ec22-41c1-8ec2-5f9aefb686c8', 'e8606f56-3286-4026-aed7-5d1d8d13cc91', '47fac796-1911-40ef-bfe3-41b57f0c985a'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:42 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Delete snapshot completed successfully. Feb 27 02:05:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-8ad96c3f-f3f9-4894-97c2-b2ce2a42fa76-delete_snapshot" released by "delete_snapshot" :: held 7.246s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "cinder-fba61f51-26e6-4b0d-ae87-aa2cd5ffba89-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-fba61f51-26e6-4b0d-ae87-aa2cd5ffba89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "cinder-quobyte-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "cinder-quobyte-fba61f51-26e6-4b0d-ae87-aa2cd5ffba89" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-fba61f51-26e6-4b0d-ae87-aa2cd5ffba89" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Deleting offline snapshot fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 of volume d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:05:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] snapshot_file for this snap is: volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:05:42 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d556b0ad-bebb-4f8c-9057-136836f35320]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:42 devstack sudo[87265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 Feb 27 02:05:42 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] Acquiring lock "cinder-quobyte-8e3db75b-7b6f-46bb-ab7b-6988998427bc" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] Lock "cinder-quobyte-8e3db75b-7b6f-46bb-ab7b-6988998427bc" acquired by "delete_volume" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:42 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3bc7d0-6fe6-4925-8fef-de7e6f22c065]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8e3db75b-7b6f-46bb-ab7b-6988998427bc {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:42 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89" returned: 0 in 0.821s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:42 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6384fc62-9b4b-407a-ab1d-cfddb7c6d4f6]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:43 devstack sudo[87287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8e3db75b-7b6f-46bb-ab7b-6988998427bc Feb 27 02:05:43 devstack sudo[87287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:43 devstack sudo[87289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf Feb 27 02:05:43 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:43 devstack sudo[87287]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8e3db75b-7b6f-46bb-ab7b-6988998427bc" returned: 0 in 0.795s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8e3db75b-7b6f-46bb-ab7b-6988998427bc {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:43 devstack sudo[87298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8e3db75b-7b6f-46bb-ab7b-6988998427bc Feb 27 02:05:43 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:43 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf" returned: 0 in 0.687s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:43 devstack sudo[87300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 Feb 27 02:05:43 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:44 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8e3db75b-7b6f-46bb-ab7b-6988998427bc" returned: 0 in 0.506s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] Lock "cinder-quobyte-8e3db75b-7b6f-46bb-ab7b-6988998427bc" released by "delete_volume" :: held 1.353s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:44 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] Created reservations ['071845b7-c7df-4ac3-a2e1-cb530a3418f4'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:44 devstack cinder-volume[83231]: WARNING cinder.quota [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1976288364 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1976288364, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:44 devstack cinder-volume[83231]: WARNING cinder.quota [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1976288364 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1976288364, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:44 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] Created reservations ['29bbdda8-f756-43d3-8de1-64750b1659f0', 'd941f13d-1921-4585-b55e-5e21d01c44f9', 'f9349e8e-e403-4ff2-bfe8-7483c78035dc', 'd734bf37-b5e1-47a6-930a-59eb83a42f1a'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:44 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89" returned: 0 in 0.654s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:44 devstack sudo[87307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89 Feb 27 02:05:44 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:44 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:44 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:44 devstack sudo[87309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:05:44 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:44 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf.fba61f51-26e6-4b0d-ae87-aa2cd5ffba89" returned: 0 in 0.516s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-fba61f51-26e6-4b0d-ae87-aa2cd5ffba89" released by "_delete_snapshot" :: held 2.738s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf" released by "delete_snapshot" :: held 2.752s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:44 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Created reservations ['ea746831-ecdc-406b-b3eb-5a74a76a7b29', '8a35dfb2-c9bb-4f9d-87b7-9b0b17d540b3', '909f0700-ca90-42f3-94fe-f70e5077d46d', '823d633c-32c5-4ff2-8bd3-3060a955ddc0'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:44 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.547s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:44 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:44 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b277c062-3430-42e2-a4aa-f4abaa37e1d9 tempest-GroupsTest-1491450596 None] Delete group completed successfully. Feb 27 02:05:44 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Delete snapshot completed successfully. Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-fba61f51-26e6-4b0d-ae87-aa2cd5ffba89-delete_snapshot" released by "delete_snapshot" :: held 2.915s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Snapshots deleted, issuing volume delete {{(pid=83231) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "cinder-quobyte-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[729312e5-1424-411f-a6b0-8171f0ac6c0e]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-156613bd-a5c4-4b26-bb0f-a0a2b5f5a889 tempest-GroupsTest-1491450596 None] Created reservations ['ddf6fe9e-0011-4ac9-b469-2730027181e5'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:45 devstack sudo[87313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf Feb 27 02:05:45 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-156613bd-a5c4-4b26-bb0f-a0a2b5f5a889 tempest-GroupsTest-1491450596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-156613bd-a5c4-4b26-bb0f-a0a2b5f5a889 tempest-GroupsTest-1491450596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-156613bd-a5c4-4b26-bb0f-a0a2b5f5a889 tempest-GroupsTest-1491450596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-156613bd-a5c4-4b26-bb0f-a0a2b5f5a889 tempest-GroupsTest-1491450596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-156613bd-a5c4-4b26-bb0f-a0a2b5f5a889 tempest-GroupsTest-1491450596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-156613bd-a5c4-4b26-bb0f-a0a2b5f5a889 tempest-GroupsTest-1491450596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:45 devstack cinder-volume[83231]: INFO cinder.volume.manager [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-1a7f7c04-42ac-4314-902d-2d39455124b8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Terminate volume connection completed successfully. Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-1a7f7c04-42ac-4314-902d-2d39455124b8 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Deleting attachment 31b44e7e-2bc5-4aab-9d00-2361a83ca9c4. {{(pid=83231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 02:05:45 devstack sudo[87315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:05:45 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:45 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-156613bd-a5c4-4b26-bb0f-a0a2b5f5a889 tempest-GroupsTest-1491450596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.661s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:45 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-156613bd-a5c4-4b26-bb0f-a0a2b5f5a889 tempest-GroupsTest-1491450596 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf" returned: 0 in 0.789s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:45 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-156613bd-a5c4-4b26-bb0f-a0a2b5f5a889 tempest-GroupsTest-1491450596 None] Delete group completed successfully. Feb 27 02:05:45 devstack sudo[87321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf Feb 27 02:05:45 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Acquiring lock "cinder-2c6d27b0-cd96-45d7-a60c-22aeb786db23-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "cinder-2c6d27b0-cd96-45d7-a60c-22aeb786db23-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Acquiring lock "cinder-quobyte-2c6d27b0-cd96-45d7-a60c-22aeb786db23" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "cinder-quobyte-2c6d27b0-cd96-45d7-a60c-22aeb786db23" acquired by "delete_volume" :: waited 0.016s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[330137ac-7622-4779-9b47-a5e29879cd04]: (4, 'raw') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:46 devstack sudo[87323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 Feb 27 02:05:46 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:46 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf" returned: 0 in 0.722s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:46 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf" released by "delete_volume" :: held 1.560s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:46 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Created reservations ['ea4c62d6-9823-4a44-a44d-0ba0d1f2ed88', 'eecee74b-a200-4713-b3ec-0117fef03151', 'b79a15b4-7e87-4a25-a115-d03e504bd8eb', '10fbcb7e-e1d3-45a6-b34f-6f35995595f1'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:46 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:05:46 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:46 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-ffee1b5e-45d1-45cb-8257-bf4b02f7cb76 tempest-GroupsTest-1491450596 None] Group tempest-GroupsTest-Group-1791114691: creating Feb 27 02:05:46 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-ffee1b5e-45d1-45cb-8257-bf4b02f7cb76 tempest-GroupsTest-1491450596 None] Group tempest-GroupsTest-Group-1791114691: created successfully Feb 27 02:05:46 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-ffee1b5e-45d1-45cb-8257-bf4b02f7cb76 tempest-GroupsTest-1491450596 None] Create group completed successfully. Feb 27 02:05:47 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23" returned: 0 in 1.117s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG oslo_service.periodic_task [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83231) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:47 devstack sudo[87330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 Feb 27 02:05:47 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:47 devstack sudo[87333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:05:47 devstack sudo[87333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:47 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.695s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:47 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Deleted volume successfully. Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-77bafc8f-6879-4448-bb0a-ca05528fb309 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-d4bb3d5a-e2d2-4fd7-9199-0d16ed1669cf-delete_volume" released by "delete_volume" :: held 12.753s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Flow 'volume_create_manager' (13888258-726b-47c6-96e2-ddf5014c32ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01d9eac-632c-47e9-9b0f-6ef9af66c6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01d9eac-632c-47e9-9b0f-6ef9af66c6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1637018819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38bb06f-54ba-436c-a540-c790b1ca7ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d82804eb6104812bd15d3a1d89b824c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:48Z,use_quota=True,user_id='9a4fbfe383f94c3386684725f093e65c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf806c1-b172-47b2-a07d-26217158fc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf806c1-b172-47b2-a07d-26217158fc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37242086-500f-4cb9-a93d-93f470393682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37242086-500f-4cb9-a93d-93f470393682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e38bb06f-54ba-436c-a540-c790b1ca7ca5', 'volume_name': 'volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2541e613-bb84-41b0-ac69-9dafd0091852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2541e613-bb84-41b0-ac69-9dafd0091852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e22190d-7f2a-4dc1-8334-96741928ffa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:47 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:47 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Volume e38bb06f-54ba-436c-a540-c790b1ca7ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5', 'volume_size': 1} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1637018819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38bb06f-54ba-436c-a540-c790b1ca7ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d82804eb6104812bd15d3a1d89b824c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:48Z,use_quota=True,user_id='9a4fbfe383f94c3386684725f093e65c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Creating volume e38bb06f-54ba-436c-a540-c790b1ca7ca5 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:47 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23" returned: 1 in 0.818s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23' failed. Not Retrying. {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:05:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:47 devstack sudo[87338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 1073741824 Feb 27 02:05:47 devstack sudo[87338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:47 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23 Feb 27 02:05:47 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:48 devstack sudo[87333]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 1.129s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:48 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:48 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Flow 'volume_create_manager' (c4192d93-29cc-49e0-a837-36009aa5e1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b720355e-49e1-4918-8c37-2ae9daf49cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:48 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b720355e-49e1-4918-8c37-2ae9daf49cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1464706639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f641970-9880-416d-9877-c72e7e2feb4f,host='devstack@QuobyteHD#QuobyteHD',id=d169947c-c0bd-4362-a20b-c55f6f911cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6d47e0c9b7044658e6cc5678be6c943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:49Z,use_quota=True,user_id='e34e28720da840a8bb01efbe3c9b40d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24f6247a-f2c3-4bda-8192-f5c3f324d795),volume_type_id=24f6247a-f2c3-4bda-8192-f5c3f324d795)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3322f931-5fe1-4294-9174-884935a30410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3322f931-5fe1-4294-9174-884935a30410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bbe9d9-f633-41ae-8b2d-8110c2d0867d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:48 devstack sudo[87338]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bbe9d9-f633-41ae-8b2d-8110c2d0867d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd169947c-c0bd-4362-a20b-c55f6f911cd5', 'volume_name': 'volume-d169947c-c0bd-4362-a20b-c55f6f911cd5', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a4535c-9ce2-461c-9bde-f301a18ddbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a4535c-9ce2-461c-9bde-f301a18ddbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (166b8d86-ab1a-435d-87c9-de5f7661edc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:48 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Volume d169947c-c0bd-4362-a20b-c55f6f911cd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d169947c-c0bd-4362-a20b-c55f6f911cd5', 'volume_size': 1} Feb 27 02:05:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2c6d27b0-cd96-45d7-a60c-22aeb786db23" returned: 0 in 0.953s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 1073741824" returned: 0 in 0.978s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "cinder-quobyte-2c6d27b0-cd96-45d7-a60c-22aeb786db23" released by "delete_volume" :: held 2.958s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:48 devstack sudo[87347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 Feb 27 02:05:48 devstack sudo[87347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:48 devstack cinder-volume[83231]: DEBUG cinder.quota [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Created reservations ['2da1e5a9-0314-4d46-93a9-a425e8bfc810', '09efeb40-8dee-4fd0-aa26-1e9a1d0af8fb', 'b8a3ef5b-0b11-4997-a15a-3fdd1203c73f', '45d4dc63-a6f2-4fff-944e-6ee010e648ee'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:49 devstack sudo[87349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:05:49 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:49 devstack sudo[87347]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5" returned: 0 in 0.667s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.734s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2f641970-9880-416d-9877-c72e7e2feb4f,created_at=2026-02-27T01:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1464706639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f641970-9880-416d-9877-c72e7e2feb4f,host='devstack@QuobyteHD#QuobyteHD',id=d169947c-c0bd-4362-a20b-c55f6f911cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6d47e0c9b7044658e6cc5678be6c943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:49Z,use_quota=True,user_id='e34e28720da840a8bb01efbe3c9b40d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24f6247a-f2c3-4bda-8192-f5c3f324d795),volume_type_id=24f6247a-f2c3-4bda-8192-f5c3f324d795)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Creating volume d169947c-c0bd-4362-a20b-c55f6f911cd5 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:49 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d169947c-c0bd-4362-a20b-c55f6f911cd5 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e22190d-7f2a-4dc1-8334-96741928ffa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a479427-e60d-4443-b9e3-f4f6de7507ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:49 devstack sudo[87353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d169947c-c0bd-4362-a20b-c55f6f911cd5 1073741824 Feb 27 02:05:49 devstack sudo[87353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:49 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Volume volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 (e38bb06f-54ba-436c-a540-c790b1ca7ca5): created successfully Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a479427-e60d-4443-b9e3-f4f6de7507ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:49 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Flow 'volume_create_manager' (13888258-726b-47c6-96e2-ddf5014c32ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.674s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG cinder.manager [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:49 devstack cinder-volume[83231]: INFO cinder.volume.manager [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Deleted volume successfully. Feb 27 02:05:49 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-c9243f6b-513e-4e66-a449-72151376b9f2 tempest-VolumesDeleteCascade-1242545037 None] Created volume successfully. Feb 27 02:05:49 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-0576fb9c-a66d-4698-9e0e-63a587e854ea req-a0d0f900-7c4e-4235-a33d-aef613b3aa60 tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "cinder-2c6d27b0-cd96-45d7-a60c-22aeb786db23-delete_volume" released by "delete_volume" :: held 3.902s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:50 devstack sudo[87353]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d169947c-c0bd-4362-a20b-c55f6f911cd5 1073741824" returned: 0 in 0.863s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d169947c-c0bd-4362-a20b-c55f6f911cd5 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:50 devstack sudo[87365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d169947c-c0bd-4362-a20b-c55f6f911cd5 Feb 27 02:05:50 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-bf8cc896-fda1-4a74-ae8c-9e779a725f06 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:51 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d169947c-c0bd-4362-a20b-c55f6f911cd5" returned: 0 in 0.753s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:51 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-bf8cc896-fda1-4a74-ae8c-9e779a725f06 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.035s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:51 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-bf8cc896-fda1-4a74-ae8c-9e779a725f06 tempest-VolumesDeleteCascade-1242545037 None] Creating offline snapshot fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b of volume e38bb06f-54ba-436c-a540-c790b1ca7ca5 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:05:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (166b8d86-ab1a-435d-87c9-de5f7661edc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d169947c-c0bd-4362-a20b-c55f6f911cd5', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9f083e-ae1c-4b0d-a19b-fec45037c926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:51 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[15585703-b70f-43d2-954c-f7755d5bf1c2]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf8cc896-fda1-4a74-ae8c-9e779a725f06 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:51 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Volume volume-d169947c-c0bd-4362-a20b-c55f6f911cd5 (d169947c-c0bd-4362-a20b-c55f6f911cd5): created successfully Feb 27 02:05:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9f083e-ae1c-4b0d-a19b-fec45037c926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Flow 'volume_create_manager' (c4192d93-29cc-49e0-a837-36009aa5e1d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:51 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-8f98ad73-3836-442a-9017-d0e05769d66f tempest-GroupsTest-1491450596 None] Created volume successfully. Feb 27 02:05:51 devstack sudo[87385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 Feb 27 02:05:51 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:51 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf8cc896-fda1-4a74-ae8c-9e779a725f06 tempest-VolumesDeleteCascade-1242545037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5" returned: 0 in 0.599s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf8cc896-fda1-4a74-ae8c-9e779a725f06 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:51 devstack sudo[87390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b 1G Feb 27 02:05:51 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Flow 'volume_create_manager' (2b5dfb72-f29e-418a-8d8f-33e3dd22a819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986192e9-31b6-49cc-be6a-4dfa4febd824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986192e9-31b6-49cc-be6a-4dfa4febd824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-915749940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f77134b-e0c9-4e20-b3c3-bce93b955c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90453e44f15d45f58dc1f66b4297f38c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:52Z,use_quota=True,user_id='7b6d7311ae0545ab8d77fd699b0f4783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c07c63-c142-4512-8838-793de39dedda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c07c63-c142-4512-8838-793de39dedda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63d3911-9635-46bf-9c12-3ec39dc0c177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63d3911-9635-46bf-9c12-3ec39dc0c177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f77134b-e0c9-4e20-b3c3-bce93b955c55', 'volume_name': 'volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c9ff3b-35db-4e7c-9015-aa3f5b79ee91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c9ff3b-35db-4e7c-9015-aa3f5b79ee91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f172ab9-ceb8-432c-9ad1-084fde2331fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:52 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Volume 0f77134b-e0c9-4e20-b3c3-bce93b955c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55', 'volume_size': 1} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Flow 'volume_create_manager' (001dcf79-6676-4bdb-8d2e-fe760ce555d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca804d7b-5cf4-40d0-8b95-6067a85cf5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca804d7b-5cf4-40d0-8b95-6067a85cf5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1499540801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f641970-9880-416d-9877-c72e7e2feb4f,host='devstack@QuobyteHD#QuobyteHD',id=f9bcbe86-424e-46f4-a92c-60350b443864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6d47e0c9b7044658e6cc5678be6c943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:52Z,use_quota=True,user_id='e34e28720da840a8bb01efbe3c9b40d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24f6247a-f2c3-4bda-8192-f5c3f324d795),volume_type_id=24f6247a-f2c3-4bda-8192-f5c3f324d795)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90bcff1-5a09-4cb4-9ef2-a4ac656a7478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90bcff1-5a09-4cb4-9ef2-a4ac656a7478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bfd5b1c-31dd-495c-9d0b-119986828b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bfd5b1c-31dd-495c-9d0b-119986828b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9bcbe86-424e-46f4-a92c-60350b443864', 'volume_name': 'volume-f9bcbe86-424e-46f4-a92c-60350b443864', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6748279d-22a3-41e5-b023-853e9eb2957e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6748279d-22a3-41e5-b023-853e9eb2957e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04eab741-0628-44b3-9128-cd7500b565c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:52 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Volume f9bcbe86-424e-46f4-a92c-60350b443864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9bcbe86-424e-46f4-a92c-60350b443864', 'volume_size': 1} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:52 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf8cc896-fda1-4a74-ae8c-9e779a725f06 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b 1G" returned: 0 in 0.718s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf8cc896-fda1-4a74-ae8c-9e779a725f06 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:52 devstack sudo[87397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b Feb 27 02:05:52 devstack sudo[87397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:53 devstack sudo[87397]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf8cc896-fda1-4a74-ae8c-9e779a725f06 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b" returned: 0 in 0.461s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:53 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-bf8cc896-fda1-4a74-ae8c-9e779a725f06 tempest-VolumesDeleteCascade-1242545037 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b is being set with open permissions: ugo+rw Feb 27 02:05:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf8cc896-fda1-4a74-ae8c-9e779a725f06 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:53 devstack sudo[87402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b Feb 27 02:05:53 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:53 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf8cc896-fda1-4a74-ae8c-9e779a725f06 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b" returned: 0 in 0.519s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf8cc896-fda1-4a74-ae8c-9e779a725f06 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:53 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.info Feb 27 02:05:53 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:54 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf8cc896-fda1-4a74-ae8c-9e779a725f06 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.info" returned: 0 in 0.552s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:54 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-bf8cc896-fda1-4a74-ae8c-9e779a725f06 tempest-VolumesDeleteCascade-1242545037 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.info is being set with open permissions: ugo+rw Feb 27 02:05:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf8cc896-fda1-4a74-ae8c-9e779a725f06 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:54 devstack sudo[87414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.info Feb 27 02:05:54 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:54 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bf8cc896-fda1-4a74-ae8c-9e779a725f06 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.info" returned: 0 in 0.495s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-bf8cc896-fda1-4a74-ae8c-9e779a725f06 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.437s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.376s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-915749940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f77134b-e0c9-4e20-b3c3-bce93b955c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90453e44f15d45f58dc1f66b4297f38c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:52Z,use_quota=True,user_id='7b6d7311ae0545ab8d77fd699b0f4783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Creating volume 0f77134b-e0c9-4e20-b3c3-bce93b955c55 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:54 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:05:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:54 devstack sudo[87418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 1073741824 Feb 27 02:05:54 devstack sudo[87418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:54 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-bf8cc896-fda1-4a74-ae8c-9e779a725f06 tempest-VolumesDeleteCascade-1242545037 None] Create snapshot completed successfully Feb 27 02:05:55 devstack sudo[87418]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 1073741824" returned: 0 in 0.610s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:55 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 Feb 27 02:05:55 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:55 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Flow 'volume_create_manager' (57a3ba15-daf2-43c6-8124-ef85dcd41aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe56e63-8709-4d2c-bced-90439e11247d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:55 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55" returned: 0 in 0.564s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.505s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2f641970-9880-416d-9877-c72e7e2feb4f,created_at=2026-02-27T01:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1499540801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f641970-9880-416d-9877-c72e7e2feb4f,host='devstack@QuobyteHD#QuobyteHD',id=f9bcbe86-424e-46f4-a92c-60350b443864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6d47e0c9b7044658e6cc5678be6c943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:52Z,use_quota=True,user_id='e34e28720da840a8bb01efbe3c9b40d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24f6247a-f2c3-4bda-8192-f5c3f324d795),volume_type_id=24f6247a-f2c3-4bda-8192-f5c3f324d795)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Creating volume f9bcbe86-424e-46f4-a92c-60350b443864 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:55 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:05:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f9bcbe86-424e-46f4-a92c-60350b443864 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f172ab9-ceb8-432c-9ad1-084fde2331fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbdc9d2-13d6-4b84-b27e-fef2851ae0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:56 devstack sudo[87426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f9bcbe86-424e-46f4-a92c-60350b443864 1073741824 Feb 27 02:05:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe56e63-8709-4d2c-bced-90439e11247d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1567268043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a27f5f-e5a6-4bef-a5bf-da31da7ceef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d82804eb6104812bd15d3a1d89b824c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:56Z,use_quota=True,user_id='9a4fbfe383f94c3386684725f093e65c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:56 devstack sudo[87426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b1f605-e0db-418e-a010-3818292d1c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b1f605-e0db-418e-a010-3818292d1c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ccff9d9-3ade-4c4c-875c-c490871a1d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ccff9d9-3ade-4c4c-875c-c490871a1d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '29a27f5f-e5a6-4bef-a5bf-da31da7ceef6', 'volume_name': 'volume-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6', 'volume_size': 1, 'snapshot_id': 'fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f85388-7415-4472-8cfb-dbd4f844f8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f85388-7415-4472-8cfb-dbd4f844f8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd41e8f-f622-4cf2-893e-2cc9b558b5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:56 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Volume 29a27f5f-e5a6-4bef-a5bf-da31da7ceef6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6', 'volume_size': 1, 'snapshot_id': 'fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b'} Feb 27 02:05:56 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Volume volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 (0f77134b-e0c9-4e20-b3c3-bce93b955c55): created successfully Feb 27 02:05:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbdc9d2-13d6-4b84-b27e-fef2851ae0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Flow 'volume_create_manager' (2b5dfb72-f29e-418a-8d8f-33e3dd22a819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:56 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-dd43264f-9df4-4e3c-a2a8-c39c3d4e6304 tempest-VolumesActionsTest-1549391068 None] Created volume successfully. Feb 27 02:05:56 devstack sudo[87426]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f9bcbe86-424e-46f4-a92c-60350b443864 1073741824" returned: 0 in 0.770s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f9bcbe86-424e-46f4-a92c-60350b443864 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:56 devstack sudo[87431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f9bcbe86-424e-46f4-a92c-60350b443864 Feb 27 02:05:56 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:57 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f9bcbe86-424e-46f4-a92c-60350b443864" returned: 0 in 0.583s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.298s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "cinder-quobyte-fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6" by "_create_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04eab741-0628-44b3-9128-cd7500b565c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9bcbe86-424e-46f4-a92c-60350b443864', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f2171a-be6b-4d5b-b008-1b8ac2a771c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Creating volume 29a27f5f-e5a6-4bef-a5bf-da31da7ceef6 from snapshot fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b {{(pid=83231) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "cinder-quobyte-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6" by "_copy_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:57 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Volume volume-f9bcbe86-424e-46f4-a92c-60350b443864 (f9bcbe86-424e-46f4-a92c-60350b443864): created successfully Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f2171a-be6b-4d5b-b008-1b8ac2a771c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Flow 'volume_create_manager' (001dcf79-6676-4bdb-8d2e-fe760ce555d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] snapshot: fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b, volume: 29a27f5f-e5a6-4bef-a5bf-da31da7ceef6, {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:57 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-ff132b3a-6060-456e-8888-721d08f10473 tempest-GroupsTest-1491450596 None] Created volume successfully. Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f823ab06-9d75-4a36-ad8a-ecf11c53ac1b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:57 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b Feb 27 02:05:57 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:57 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-af73d8f0-b6b6-4281-8523-4d70cab2c6f0 tempest-GroupsTest-1491450596 None] Update group completed successfully. Feb 27 02:05:58 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b" returned: 0 in 0.725s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:05:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Creating direct copy from snapshot {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:05:58 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be049e1-c4a7-4a3e-906d-543f08b6d2dd]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:58 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 Feb 27 02:05:58 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:58 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5" returned: 0 in 0.539s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:58 devstack cinder-volume[83231]: DEBUG cinder.utils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Path /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6 not found in is_blk_device check {{(pid=83231) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:05:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:58 devstack sudo[87476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6 Feb 27 02:05:58 devstack sudo[87476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:59 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-6bcbd042-6de1-4364-a6d7-806c4c1e5298 tempest-GroupsTest-1491450596 None] Update group completed successfully. Feb 27 02:06:00 devstack cinder-volume[83231]: INFO cinder.volume.manager [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-a804c6f0-a6ab-44fc-8da2-9c5e5ff6240a tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Terminate volume connection completed successfully. Feb 27 02:06:00 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-a804c6f0-a6ab-44fc-8da2-9c5e5ff6240a tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Deleting attachment 3193f383-f72e-4f38-8160-701e8f23be62. {{(pid=83231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 02:06:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Acquiring lock "cinder-fdca9f0f-d22e-4144-bd97-829cd47b649d-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "cinder-fdca9f0f-d22e-4144-bd97-829cd47b649d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Acquiring lock "cinder-quobyte-fdca9f0f-d22e-4144-bd97-829cd47b649d" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "cinder-quobyte-fdca9f0f-d22e-4144-bd97-829cd47b649d" acquired by "delete_volume" :: waited 0.031s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:01 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec30a9e-d14f-4446-a6c5-4e5dd413cf41]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fdca9f0f-d22e-4144-bd97-829cd47b649d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:01 devstack sudo[87489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fdca9f0f-d22e-4144-bd97-829cd47b649d Feb 27 02:06:01 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Acquiring lock "cinder-quobyte-d169947c-c0bd-4362-a20b-c55f6f911cd5" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Lock "cinder-quobyte-d169947c-c0bd-4362-a20b-c55f6f911cd5" acquired by "delete_volume" :: waited 0.023s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:01 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f7e722-3a44-4fe3-b95b-81a94c258d22]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d169947c-c0bd-4362-a20b-c55f6f911cd5 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:01 devstack sudo[87491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d169947c-c0bd-4362-a20b-c55f6f911cd5 Feb 27 02:06:01 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:01 devstack sudo[87476]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6" returned: 0 in 3.149s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:01 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[099fd5a1-28a1-4005-8375-b304b91fab9d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:02 devstack sudo[87493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 Feb 27 02:06:02 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:02 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fdca9f0f-d22e-4144-bd97-829cd47b649d" returned: 0 in 1.043s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fdca9f0f-d22e-4144-bd97-829cd47b649d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:02 devstack sudo[87498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fdca9f0f-d22e-4144-bd97-829cd47b649d Feb 27 02:06:02 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:02 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d169947c-c0bd-4362-a20b-c55f6f911cd5" returned: 0 in 0.716s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d169947c-c0bd-4362-a20b-c55f6f911cd5 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:02 devstack sudo[87504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d169947c-c0bd-4362-a20b-c55f6f911cd5 Feb 27 02:06:02 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:03 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fdca9f0f-d22e-4144-bd97-829cd47b649d" returned: 0 in 0.781s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "cinder-quobyte-fdca9f0f-d22e-4144-bd97-829cd47b649d" released by "delete_volume" :: held 1.906s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:03 devstack cinder-volume[83231]: DEBUG cinder.quota [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Created reservations ['8c868a36-7266-40ed-a6f9-4ac34f641ce2', '0a927fd9-2e6c-459f-b8a3-efe64a971836', '87f990ba-b882-456f-8af8-dc1ce34f509c', '336de92b-6fef-4c34-ac12-e87025e31394'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:03 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:03 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d169947c-c0bd-4362-a20b-c55f6f911cd5" returned: 0 in 0.743s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5" returned: 0 in 1.258s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:03 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Image conversion details: src /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5, size 1024.00 MB, duration 3.15 sec, destination /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6 {{(pid=83231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:06:03 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Converted 1024.00 MB image at 325.06 MB/s Feb 27 02:06:03 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6 is being set with open permissions: ugo+rw Feb 27 02:06:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:03 devstack sudo[87511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6 Feb 27 02:06:03 devstack sudo[87511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Lock "cinder-quobyte-d169947c-c0bd-4362-a20b-c55f6f911cd5" released by "delete_volume" :: held 1.556s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Acquiring lock "cinder-quobyte-f9bcbe86-424e-46f4-a92c-60350b443864" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Lock "cinder-quobyte-f9bcbe86-424e-46f4-a92c-60350b443864" acquired by "delete_volume" :: waited 0.018s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:03 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8058fb13-785f-4d7b-9a97-12ad08fb441d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f9bcbe86-424e-46f4-a92c-60350b443864 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:03 devstack sudo[87514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:06:03 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:03 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f9bcbe86-424e-46f4-a92c-60350b443864 Feb 27 02:06:03 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:04 devstack sudo[87511]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6" returned: 0 in 0.748s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6" released by "_copy_volume_from_snapshot" :: held 6.556s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6" released by "_create_volume_from_snapshot" :: held 6.618s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.666s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd41e8f-f622-4cf2-893e-2cc9b558b5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6', 'volume_size': 1, 'snapshot_id': 'fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe4d11c-643f-4af3-9178-3dd94aea35d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:04 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Volume volume-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6 (29a27f5f-e5a6-4bef-a5bf-da31da7ceef6): created successfully Feb 27 02:06:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe4d11c-643f-4af3-9178-3dd94aea35d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Flow 'volume_create_manager' (57a3ba15-daf2-43c6-8124-ef85dcd41aa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:04 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-e04e78cc-3a64-4261-8406-e87267ba09a3 tempest-VolumesDeleteCascade-1242545037 None] Created volume successfully. Feb 27 02:06:04 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.861s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:04 devstack cinder-volume[83231]: DEBUG cinder.manager [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:04 devstack cinder-volume[83231]: INFO cinder.volume.manager [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Deleted volume successfully. Feb 27 02:06:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-0c532ccb-d1c5-4a82-a76e-6b54140abdd8 req-bb2da805-fc1c-4700-bb2c-8247ad4f8b5f tempest-ServerBootFromVolumeStableRescueTest-1869494333 None] Lock "cinder-fdca9f0f-d22e-4144-bd97-829cd47b649d-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:04 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f9bcbe86-424e-46f4-a92c-60350b443864" returned: 0 in 0.942s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f9bcbe86-424e-46f4-a92c-60350b443864 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:04 devstack sudo[87524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f9bcbe86-424e-46f4-a92c-60350b443864 Feb 27 02:06:04 devstack sudo[87524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:04 devstack sudo[87524]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f9bcbe86-424e-46f4-a92c-60350b443864" returned: 0 in 0.623s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "cinder-e38bb06f-54ba-436c-a540-c790b1ca7ca5-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Lock "cinder-quobyte-f9bcbe86-424e-46f4-a92c-60350b443864" released by "delete_volume" :: held 1.615s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-e38bb06f-54ba-436c-a540-c790b1ca7ca5-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Performing cascade delete. {{(pid=83231) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "cinder-fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Created reservations ['58500a5d-a2f4-412f-b565-a5d89c480058'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "cinder-quobyte-e38bb06f-54ba-436c-a540-c790b1ca7ca5" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-e38bb06f-54ba-436c-a540-c790b1ca7ca5" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "cinder-quobyte-fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Deleting offline snapshot fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b of volume e38bb06f-54ba-436c-a540-c790b1ca7ca5 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] snapshot_file for this snap is: volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:06:05 devstack cinder-volume[83231]: WARNING cinder.quota [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-968922866 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-968922866, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:06:05 devstack cinder-volume[83231]: WARNING cinder.quota [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-968922866 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-968922866, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[512b89aa-8677-42fa-b796-6be5abbf122d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Created reservations ['2adee78a-da2b-43f4-a50a-1dd64376a86c', 'd22fc8d7-1bca-4e6f-a297-bb04132f922c', '650db605-9525-48b4-8878-07a752d05016', '3b4c62f6-8ada-4a04-afb4-f45a91828d1d'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:05 devstack sudo[87541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b Feb 27 02:06:05 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Created reservations ['3fad7a4d-0436-4ff5-b01b-d6a70f25b037', '7c9a6947-08a5-44a4-8c37-fdf0afdf0921', '05e6fe95-2ef2-4d35-9e11-7fa577f02fe0', 'cf8f6f79-9ea0-469a-87eb-aeea55c4059d'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:05 devstack sudo[87543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:06:05 devstack sudo[87543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:05 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b" returned: 0 in 0.707s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f74f71d-5881-4f92-b0dc-1e7a01d42bd8]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:06 devstack sudo[87543]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.617s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:06 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:06 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-6bc49501-bf7d-4f98-98f0-4107fb063cc6 tempest-GroupsTest-1491450596 None] Delete group completed successfully. Feb 27 02:06:06 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 Feb 27 02:06:06 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:06 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5" returned: 0 in 0.768s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:06 devstack sudo[87578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b Feb 27 02:06:06 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:07 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b" returned: 0 in 0.684s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:07 devstack sudo[87585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b Feb 27 02:06:07 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:07 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5.fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b" returned: 0 in 0.607s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b" released by "_delete_snapshot" :: held 2.873s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-e38bb06f-54ba-436c-a540-c790b1ca7ca5" released by "delete_snapshot" :: held 2.902s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:08 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Created reservations ['3269593a-414f-455f-a502-3b2c0530c12c', 'd2855845-f8cd-4c48-a751-7a412c5ae018', '5529a89e-ef15-422f-b21b-69867a07edc4', '599884a0-6641-4ae1-8fd4-a488265dcb2b'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:08 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Delete snapshot completed successfully. Feb 27 02:06:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-fdc7dc26-024c-4c3a-9fc5-8df06fa72b2b-delete_snapshot" released by "delete_snapshot" :: held 3.054s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Snapshots deleted, issuing volume delete {{(pid=83231) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 27 02:06:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "cinder-quobyte-e38bb06f-54ba-436c-a540-c790b1ca7ca5" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-e38bb06f-54ba-436c-a540-c790b1ca7ca5" acquired by "delete_volume" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:08 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[347b8c11-b9c7-472d-881f-278e8171f744]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:08 devstack sudo[87589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 Feb 27 02:06:08 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:08 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5" returned: 0 in 0.723s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:08 devstack sudo[87617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5 Feb 27 02:06:08 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:09 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e38bb06f-54ba-436c-a540-c790b1ca7ca5" returned: 0 in 0.751s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:09 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-e38bb06f-54ba-436c-a540-c790b1ca7ca5" released by "delete_volume" :: held 1.507s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:09 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Created reservations ['820c5381-d9af-4bb0-be01-8b86b6bd8937', 'd7392b04-2856-4fed-bbbc-f6220c7a290a', '0eb6dbf6-5684-4446-bd45-79992ea00b0a', 'be4b3e86-5056-4d0c-82b6-594a62cc3217'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:09 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:09 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:09 devstack sudo[87622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:06:09 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:10 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.498s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:10 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:10 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Deleted volume successfully. Feb 27 02:06:10 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-091de97b-df40-487f-b5f2-0172fa4ca975 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-e38bb06f-54ba-436c-a540-c790b1ca7ca5-delete_volume" released by "delete_volume" :: held 5.279s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:10 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "cinder-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:10 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:10 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "cinder-quobyte-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:10 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6" acquired by "delete_volume" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:10 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fa514b-de31-4499-a7cb-db39a057d5ad]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:10 devstack sudo[87625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6 Feb 27 02:06:10 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:11 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6" returned: 0 in 0.715s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:11 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6 Feb 27 02:06:11 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:12 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6" returned: 0 in 0.789s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:12 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-quobyte-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6" released by "delete_volume" :: held 1.540s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:12 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] Created reservations ['538fdf73-0f78-4b8a-bbd9-30dd1dd01f3c', '4dade47c-d01d-41ef-b26c-7d517a1b0491', '9c26f953-f985-435b-91ef-4dadc8ef3e34', 'ca1cf54f-7a44-4d46-abb1-26c636467513'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:12 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:06:12 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:12 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.593s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:12 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:12 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] Deleted volume successfully. Feb 27 02:06:13 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7a9be5a6-e33e-4975-95b0-0943ee25e918 tempest-VolumesDeleteCascade-1242545037 None] Lock "cinder-29a27f5f-e5a6-4bef-a5bf-da31da7ceef6-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:13 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7665f06e-4745-4836-9de4-035555d75c25 tempest-VolumesActionsTest-1549391068 None] Acquiring lock "cinder-0f77134b-e0c9-4e20-b3c3-bce93b955c55" by "attach_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:13 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7665f06e-4745-4836-9de4-035555d75c25 tempest-VolumesActionsTest-1549391068 None] Lock "cinder-0f77134b-e0c9-4e20-b3c3-bce93b955c55" acquired by "attach_volume" :: waited 0.016s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:13 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-7665f06e-4745-4836-9de4-035555d75c25 tempest-VolumesActionsTest-1549391068 None] Attaching volume 0f77134b-e0c9-4e20-b3c3-bce93b955c55 to instance e4127a5c-da1d-4097-a925-0cfaa91d1b78 at mountpoint /dev/vdb on host None. Feb 27 02:06:13 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-7665f06e-4745-4836-9de4-035555d75c25 tempest-VolumesActionsTest-1549391068 None] Attach volume completed successfully. Feb 27 02:06:13 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7665f06e-4745-4836-9de4-035555d75c25 tempest-VolumesActionsTest-1549391068 None] Lock "cinder-0f77134b-e0c9-4e20-b3c3-bce93b955c55" released by "attach_volume" :: held 0.106s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7b067ade-cc03-4e4b-9acd-42093049508c tempest-VolumesActionsTest-1549391068 None] Acquiring lock "cinder-0f77134b-e0c9-4e20-b3c3-bce93b955c55-detach_volume" by "detach_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7b067ade-cc03-4e4b-9acd-42093049508c tempest-VolumesActionsTest-1549391068 None] Lock "cinder-0f77134b-e0c9-4e20-b3c3-bce93b955c55-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:14 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-7b067ade-cc03-4e4b-9acd-42093049508c tempest-VolumesActionsTest-1549391068 None] Detaching volume 0f77134b-e0c9-4e20-b3c3-bce93b955c55 from instance e4127a5c-da1d-4097-a925-0cfaa91d1b78. Feb 27 02:06:14 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-7b067ade-cc03-4e4b-9acd-42093049508c tempest-VolumesActionsTest-1549391068 None] Detach volume completed successfully. Feb 27 02:06:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7b067ade-cc03-4e4b-9acd-42093049508c tempest-VolumesActionsTest-1549391068 None] Lock "cinder-0f77134b-e0c9-4e20-b3c3-bce93b955c55-detach_volume" released by "detach_volume" :: held 0.148s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Flow 'volume_create_manager' (77eeb3ab-2dec-48c8-918b-4f1c120340aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b701b585-b208-40d9-b7c3-f5a74722549c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b701b585-b208-40d9-b7c3-f5a74722549c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-75936037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06688986-2298-47d3-8554-751c634b7ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed9233675349485092ff643984af1cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:17Z,use_quota=True,user_id='f227d1815ca446bf9f278319fd963712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381cfc9a-9ab6-4a94-b34f-e105cd10d786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381cfc9a-9ab6-4a94-b34f-e105cd10d786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb22e62-2dc2-446d-b7bb-7040f488013c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb22e62-2dc2-446d-b7bb-7040f488013c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06688986-2298-47d3-8554-751c634b7ae9', 'volume_name': 'volume-06688986-2298-47d3-8554-751c634b7ae9', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abaf1de9-735f-412e-8a7e-111e8e382194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abaf1de9-735f-412e-8a7e-111e8e382194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad36a49c-d7b2-451a-aa73-1ca9300a2802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:16 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Volume 06688986-2298-47d3-8554-751c634b7ae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06688986-2298-47d3-8554-751c634b7ae9', 'volume_size': 1} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-75936037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06688986-2298-47d3-8554-751c634b7ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed9233675349485092ff643984af1cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:17Z,use_quota=True,user_id='f227d1815ca446bf9f278319fd963712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Creating volume 06688986-2298-47d3-8554-751c634b7ae9 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:16 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:06:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:16 devstack sudo[87673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 1073741824 Feb 27 02:06:16 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:17 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 1073741824" returned: 0 in 0.782s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:17 devstack sudo[87678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 Feb 27 02:06:17 devstack sudo[87678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:18 devstack sudo[87678]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9" returned: 0 in 0.627s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:18 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad36a49c-d7b2-451a-aa73-1ca9300a2802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06688986-2298-47d3-8554-751c634b7ae9', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:18 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14f07ec-6cfe-4f7f-8808-b430ea6f6797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:18 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Volume volume-06688986-2298-47d3-8554-751c634b7ae9 (06688986-2298-47d3-8554-751c634b7ae9): created successfully Feb 27 02:06:18 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14f07ec-6cfe-4f7f-8808-b430ea6f6797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:18 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Flow 'volume_create_manager' (77eeb3ab-2dec-48c8-918b-4f1c120340aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:18 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-e0bbe6c4-cb37-4175-a377-ee244ada3c78 tempest-VolumesCloneTest-369735363 None] Created volume successfully. Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Flow 'volume_create_manager' (a99d5a03-155e-40c0-9f6c-179b528ceefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0caf38-bc0b-45ac-ac0b-a4b9aa331148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0caf38-bc0b-45ac-ac0b-a4b9aa331148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1395392302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e318f31-9a40-4837-9384-87edee849a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed9233675349485092ff643984af1cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=06688986-2298-47d3-8554-751c634b7ae9,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:19Z,use_quota=True,user_id='f227d1815ca446bf9f278319fd963712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9ab8f7-de09-436d-a6ef-a33d2d530999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9ab8f7-de09-436d-a6ef-a33d2d530999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32f4acb-629d-4a61-a3c0-b406ebecc9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32f4acb-629d-4a61-a3c0-b406ebecc9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9e318f31-9a40-4837-9384-87edee849a6f', 'volume_name': 'volume-9e318f31-9a40-4837-9384-87edee849a6f', 'volume_size': 2, 'source_volid': '06688986-2298-47d3-8554-751c634b7ae9', 'source_volstatus': 'available'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a31abd-62ca-417a-a03e-74db663fee1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a31abd-62ca-417a-a03e-74db663fee1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8192cb4-3d27-4a70-9d44-1e38b82e633f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Volume 9e318f31-9a40-4837-9384-87edee849a6f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9e318f31-9a40-4837-9384-87edee849a6f', 'volume_size': 2, 'source_volid': '06688986-2298-47d3-8554-751c634b7ae9', 'source_volstatus': 'available'} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:19 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Cloning volume 06688986-2298-47d3-8554-751c634b7ae9 to volume 9e318f31-9a40-4837-9384-87edee849a6f Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Flow 'volume_create_manager' (11a8bc5b-8b9a-4143-8565-f990cfacdbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16d4308-481a-402b-8afb-b0e62d034818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16d4308-481a-402b-8afb-b0e62d034818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-342157131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966e1651-be7c-41f7-b131-593399464b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50cb7cfd11ba46ab922d03622df27c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:19Z,use_quota=True,user_id='39547d862f5441f393e0064296c73ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d226c934-d9ea-4d33-825e-bd08ea07a8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d226c934-d9ea-4d33-825e-bd08ea07a8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9f7c85-9b33-452a-8f1c-160b2086ba89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9f7c85-9b33-452a-8f1c-160b2086ba89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '966e1651-be7c-41f7-b131-593399464b36', 'volume_name': 'volume-966e1651-be7c-41f7-b131-593399464b36', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e546cc-af9b-4c1b-a686-69249b7d3e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e546cc-af9b-4c1b-a686-69249b7d3e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ced433f-f274-4c47-a924-466fa4ec136c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Volume 966e1651-be7c-41f7-b131-593399464b36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-966e1651-be7c-41f7-b131-593399464b36', 'volume_size': 1} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Creating offline snapshot 2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594 of volume 06688986-2298-47d3-8554-751c634b7ae9 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3f87c6-df88-4bdc-8230-6b377d8797fe]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:19 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 Feb 27 02:06:19 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:20 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9" returned: 0 in 0.650s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:20 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594 1G Feb 27 02:06:20 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:20 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594 1G" returned: 0 in 0.602s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06688986-2298-47d3-8554-751c634b7ae9 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:20 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06688986-2298-47d3-8554-751c634b7ae9 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594 Feb 27 02:06:20 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:21 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06688986-2298-47d3-8554-751c634b7ae9 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594" returned: 0 in 0.564s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:21 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594 is being set with open permissions: ugo+rw Feb 27 02:06:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:21 devstack sudo[87731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594 Feb 27 02:06:21 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:21 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594" returned: 0 in 0.582s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:21 devstack sudo[87734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.info Feb 27 02:06:21 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:22 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.info" returned: 0 in 0.530s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:22 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.info is being set with open permissions: ugo+rw Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:22 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.info Feb 27 02:06:22 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Flow 'volume_create_manager' (75ce0b31-eb06-4a6e-b4d4-8b89497e0028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faaa50a6-a6f8-416e-94a1-d9aeb31578f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faaa50a6-a6f8-416e-94a1-d9aeb31578f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1864201215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d9417a-5688-4631-920a-ce46b2dc02bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacae06ebc1843ba997cee8f77e90b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:23Z,use_quota=True,user_id='7f04bd5e8de34e9f9ae59630421323a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134667b4-3b18-486f-a54a-3edcf512ea73),volume_type_id=134667b4-3b18-486f-a54a-3edcf512ea73)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c479ef-6fb1-47bc-aa2a-2db72896672d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c479ef-6fb1-47bc-aa2a-2db72896672d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f628a4c6-b9cd-46aa-aa28-47cae363124c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f628a4c6-b9cd-46aa-aa28-47cae363124c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7d9417a-5688-4631-920a-ce46b2dc02bb', 'volume_name': 'volume-d7d9417a-5688-4631-920a-ce46b2dc02bb', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938b33ee-99bb-468f-8252-df0f1bea0cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938b33ee-99bb-468f-8252-df0f1bea0cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36163174-b3d4-4d50-8726-83c64b82c604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:22 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Volume d7d9417a-5688-4631-920a-ce46b2dc02bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7d9417a-5688-4631-920a-ce46b2dc02bb', 'volume_size': 1} Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:22 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.info" returned: 0 in 0.525s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Acquiring lock "cinder-quobyte-9e318f31-9a40-4837-9384-87edee849a6f" by "_copy_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Lock "cinder-quobyte-9e318f31-9a40-4837-9384-87edee849a6f" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] snapshot: 2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594, volume: 9e318f31-9a40-4837-9384-87edee849a6f, {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:23 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4376df5a-b932-4dad-af0e-62550dc5ab3a]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:23 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594 Feb 27 02:06:23 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:23 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594" returned: 0 in 0.538s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06688986-2298-47d3-8554-751c634b7ae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:06:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Creating direct copy from snapshot {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:06:23 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d677e55-39ff-4835-8680-3c5f8873cace]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:23 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 Feb 27 02:06:23 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:24 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9" returned: 0 in 0.494s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:24 devstack cinder-volume[83231]: DEBUG cinder.utils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Path /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9e318f31-9a40-4837-9384-87edee849a6f not found in is_blk_device check {{(pid=83231) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:06:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9e318f31-9a40-4837-9384-87edee849a6f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:24 devstack sudo[87753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9e318f31-9a40-4837-9384-87edee849a6f Feb 27 02:06:24 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:26 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9e318f31-9a40-4837-9384-87edee849a6f" returned: 0 in 2.336s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:26 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9a13b6-8e2c-4134-bafc-5169b009b783]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:26 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 Feb 27 02:06:26 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:27 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9" returned: 0 in 0.636s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:27 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Image conversion details: src /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9, size 1024.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9e318f31-9a40-4837-9384-87edee849a6f {{(pid=83231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:06:27 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Converted 1024.00 MB image at 438.13 MB/s Feb 27 02:06:27 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9e318f31-9a40-4837-9384-87edee849a6f is being set with open permissions: ugo+rw Feb 27 02:06:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9e318f31-9a40-4837-9384-87edee849a6f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:27 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9e318f31-9a40-4837-9384-87edee849a6f Feb 27 02:06:27 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:27 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9e318f31-9a40-4837-9384-87edee849a6f" returned: 0 in 0.497s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Lock "cinder-quobyte-9e318f31-9a40-4837-9384-87edee849a6f" released by "_copy_volume_from_snapshot" :: held 4.548s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Acquiring lock "cinder-quobyte-2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Lock "cinder-quobyte-2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:27 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Deleting offline snapshot 2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594 of volume 06688986-2298-47d3-8554-751c634b7ae9 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:06:27 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] snapshot_file for this snap is: volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:06:27 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fb9788-9daa-4b70-86dc-5404884f6a37]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:27 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594 Feb 27 02:06:27 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:28 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594" returned: 0 in 0.549s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:28 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06688986-2298-47d3-8554-751c634b7ae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:28 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e06d820-6d63-4902-9b45-7bf466a4e22a]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:28 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 Feb 27 02:06:28 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:28 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9" returned: 0 in 0.604s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:28 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594 Feb 27 02:06:28 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:29 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594" returned: 0 in 0.555s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:29 devstack sudo[87789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594 Feb 27 02:06:29 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:29 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9.2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594" returned: 0 in 0.519s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Lock "cinder-quobyte-2f74fd3a-4ab1-4f8d-8e84-c2f7e66b1594" released by "_delete_snapshot" :: held 2.285s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.515s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.439s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-342157131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966e1651-be7c-41f7-b131-593399464b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50cb7cfd11ba46ab922d03622df27c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:19Z,use_quota=True,user_id='39547d862f5441f393e0064296c73ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Creating volume 966e1651-be7c-41f7-b131-593399464b36 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:29 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:06:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8192cb4-3d27-4a70-9d44-1e38b82e633f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e318f31-9a40-4837-9384-87edee849a6f', 'volume_size': 2, 'source_volid': '06688986-2298-47d3-8554-751c634b7ae9', 'source_volstatus': 'available'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:29 devstack sudo[87807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36 1073741824 Feb 27 02:06:29 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ce0511-09a9-4cc3-a639-d59736a9f614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:29 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Volume volume-9e318f31-9a40-4837-9384-87edee849a6f (9e318f31-9a40-4837-9384-87edee849a6f): created successfully Feb 27 02:06:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ce0511-09a9-4cc3-a639-d59736a9f614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Flow 'volume_create_manager' (a99d5a03-155e-40c0-9f6c-179b528ceefc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:29 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-50f72acd-c48e-4a11-acc7-7b10dddc5454 tempest-VolumesCloneTest-369735363 None] Created volume successfully. Feb 27 02:06:30 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36 1073741824" returned: 0 in 0.565s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:30 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36 Feb 27 02:06:30 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:30 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36" returned: 0 in 0.510s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.349s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1864201215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d9417a-5688-4631-920a-ce46b2dc02bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacae06ebc1843ba997cee8f77e90b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:23Z,use_quota=True,user_id='7f04bd5e8de34e9f9ae59630421323a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134667b4-3b18-486f-a54a-3edcf512ea73),volume_type_id=134667b4-3b18-486f-a54a-3edcf512ea73)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Creating volume d7d9417a-5688-4631-920a-ce46b2dc02bb {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:31 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:31 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:06:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d7d9417a-5688-4631-920a-ce46b2dc02bb 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:31 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d7d9417a-5688-4631-920a-ce46b2dc02bb 1073741824 Feb 27 02:06:31 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:31 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ced433f-f274-4c47-a924-466fa4ec136c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-966e1651-be7c-41f7-b131-593399464b36', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:31 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2c92ea-d61a-4ef7-8ef3-fefd6b211e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:31 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Volume volume-966e1651-be7c-41f7-b131-593399464b36 (966e1651-be7c-41f7-b131-593399464b36): created successfully Feb 27 02:06:31 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2c92ea-d61a-4ef7-8ef3-fefd6b211e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:31 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Flow 'volume_create_manager' (11a8bc5b-8b9a-4143-8565-f990cfacdbc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] Acquiring lock "cinder-9e318f31-9a40-4837-9384-87edee849a6f-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:31 devstack cinder-volume[83231]: INFO cinder.volume.manager [req-a3ba1ec0-5141-4a26-8df1-dcaf49b504b3 req-a215ec88-a81f-4c89-9bbc-1fe6caf58969 tempest-VolumesSnapshotsTestJSON-1938034567 None] Created volume successfully. Feb 27 02:06:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] Lock "cinder-9e318f31-9a40-4837-9384-87edee849a6f-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] Acquiring lock "cinder-quobyte-9e318f31-9a40-4837-9384-87edee849a6f" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] Lock "cinder-quobyte-9e318f31-9a40-4837-9384-87edee849a6f" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:31 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90518b4-f63d-44aa-a53a-a082b91a2054]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9e318f31-9a40-4837-9384-87edee849a6f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:31 devstack sudo[87817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9e318f31-9a40-4837-9384-87edee849a6f Feb 27 02:06:31 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-9dcf5056-16c6-43e3-a29a-963f07b5545a req-51577ec9-75b2-45d1-97d4-904dedd54282 tempest-VolumesSnapshotsTestJSON-1938034567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:31 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d7d9417a-5688-4631-920a-ce46b2dc02bb 1073741824" returned: 0 in 0.788s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d7d9417a-5688-4631-920a-ce46b2dc02bb {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:31 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d7d9417a-5688-4631-920a-ce46b2dc02bb Feb 27 02:06:31 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:31 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9e318f31-9a40-4837-9384-87edee849a6f" returned: 0 in 0.688s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9e318f31-9a40-4837-9384-87edee849a6f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:31 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9e318f31-9a40-4837-9384-87edee849a6f Feb 27 02:06:31 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:32 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d7d9417a-5688-4631-920a-ce46b2dc02bb" returned: 0 in 0.498s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-9dcf5056-16c6-43e3-a29a-963f07b5545a req-51577ec9-75b2-45d1-97d4-904dedd54282 tempest-VolumesSnapshotsTestJSON-1938034567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.677s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36163174-b3d4-4d50-8726-83c64b82c604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7d9417a-5688-4631-920a-ce46b2dc02bb', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68927f0-7d9e-4930-88b4-4e9ed858f436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [req-9dcf5056-16c6-43e3-a29a-963f07b5545a req-51577ec9-75b2-45d1-97d4-904dedd54282 tempest-VolumesSnapshotsTestJSON-1938034567 None] Creating offline snapshot f05bad10-48c7-45be-af79-4f928bc92802 of volume 966e1651-be7c-41f7-b131-593399464b36 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:06:32 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Volume volume-d7d9417a-5688-4631-920a-ce46b2dc02bb (d7d9417a-5688-4631-920a-ce46b2dc02bb): created successfully Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68927f0-7d9e-4930-88b4-4e9ed858f436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Flow 'volume_create_manager' (75ce0b31-eb06-4a6e-b4d4-8b89497e0028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6285e7ba-2d9a-4cde-8f6b-f96b0db08893]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-9dcf5056-16c6-43e3-a29a-963f07b5545a req-51577ec9-75b2-45d1-97d4-904dedd54282 tempest-VolumesSnapshotsTestJSON-1938034567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:32 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-4c421155-c7d4-4d90-9597-e0d018f2b188 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Created volume successfully. Feb 27 02:06:32 devstack sudo[87831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36 Feb 27 02:06:32 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:32 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9e318f31-9a40-4837-9384-87edee849a6f" returned: 0 in 0.530s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] Lock "cinder-quobyte-9e318f31-9a40-4837-9384-87edee849a6f" released by "delete_volume" :: held 1.249s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] Created reservations ['1790b6f0-0447-44c1-a729-76a276172f42', 'a839fc34-3524-4433-918c-607fd442fb14', '3c07d506-7dd1-4fb3-9756-1efc3974c17d', 'f4ec4c80-c7a8-40a1-939c-1174ffb2a9f3'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:32 devstack sudo[87834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:06:32 devstack sudo[87834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:32 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-9dcf5056-16c6-43e3-a29a-963f07b5545a req-51577ec9-75b2-45d1-97d4-904dedd54282 tempest-VolumesSnapshotsTestJSON-1938034567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36" returned: 0 in 0.548s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-9dcf5056-16c6-43e3-a29a-963f07b5545a req-51577ec9-75b2-45d1-97d4-904dedd54282 tempest-VolumesSnapshotsTestJSON-1938034567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:32 devstack sudo[87843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802 1G Feb 27 02:06:32 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:32 devstack sudo[87834]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.461s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:33 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:33 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] Deleted volume successfully. Feb 27 02:06:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-de497c72-16d2-4a85-bf28-78dd0f1c6dad tempest-VolumesCloneTest-369735363 None] Lock "cinder-9e318f31-9a40-4837-9384-87edee849a6f-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] Acquiring lock "cinder-06688986-2298-47d3-8554-751c634b7ae9-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] Lock "cinder-06688986-2298-47d3-8554-751c634b7ae9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] Acquiring lock "cinder-quobyte-06688986-2298-47d3-8554-751c634b7ae9" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] Lock "cinder-quobyte-06688986-2298-47d3-8554-751c634b7ae9" acquired by "delete_volume" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:33 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fa1458-ba88-4776-8b0e-d19b2d56b35a]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:33 devstack sudo[87848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 Feb 27 02:06:33 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:33 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-9dcf5056-16c6-43e3-a29a-963f07b5545a req-51577ec9-75b2-45d1-97d4-904dedd54282 tempest-VolumesSnapshotsTestJSON-1938034567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802 1G" returned: 0 in 0.653s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-9dcf5056-16c6-43e3-a29a-963f07b5545a req-51577ec9-75b2-45d1-97d4-904dedd54282 tempest-VolumesSnapshotsTestJSON-1938034567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-966e1651-be7c-41f7-b131-593399464b36 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:33 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-966e1651-be7c-41f7-b131-593399464b36 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802 Feb 27 02:06:33 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ee03244e-fdff-43be-8df4-4550ae622f4a tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ee03244e-fdff-43be-8df4-4550ae622f4a tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:33 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ee03244e-fdff-43be-8df4-4550ae622f4a tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:33 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ee03244e-fdff-43be-8df4-4550ae622f4a tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ee03244e-fdff-43be-8df4-4550ae622f4a tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ee03244e-fdff-43be-8df4-4550ae622f4a tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:33 devstack sudo[87852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:06:33 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:34 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9" returned: 0 in 0.627s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:34 devstack sudo[87860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9 Feb 27 02:06:34 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:34 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-9dcf5056-16c6-43e3-a29a-963f07b5545a req-51577ec9-75b2-45d1-97d4-904dedd54282 tempest-VolumesSnapshotsTestJSON-1938034567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-966e1651-be7c-41f7-b131-593399464b36 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802" returned: 0 in 0.537s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:34 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [req-9dcf5056-16c6-43e3-a29a-963f07b5545a req-51577ec9-75b2-45d1-97d4-904dedd54282 tempest-VolumesSnapshotsTestJSON-1938034567 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802 is being set with open permissions: ugo+rw Feb 27 02:06:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-9dcf5056-16c6-43e3-a29a-963f07b5545a req-51577ec9-75b2-45d1-97d4-904dedd54282 tempest-VolumesSnapshotsTestJSON-1938034567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:34 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802 Feb 27 02:06:34 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:34 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ee03244e-fdff-43be-8df4-4550ae622f4a tempest-VolumeRetypeWithoutMigrationTest-16226366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.735s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:34 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-ee03244e-fdff-43be-8df4-4550ae622f4a tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:34 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-ee03244e-fdff-43be-8df4-4550ae622f4a tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Retype volume completed successfully. Feb 27 02:06:34 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-9dcf5056-16c6-43e3-a29a-963f07b5545a req-51577ec9-75b2-45d1-97d4-904dedd54282 tempest-VolumesSnapshotsTestJSON-1938034567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802" returned: 0 in 0.744s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:34 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-06688986-2298-47d3-8554-751c634b7ae9" returned: 0 in 0.835s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] Lock "cinder-quobyte-06688986-2298-47d3-8554-751c634b7ae9" released by "delete_volume" :: held 1.515s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-9dcf5056-16c6-43e3-a29a-963f07b5545a req-51577ec9-75b2-45d1-97d4-904dedd54282 tempest-VolumesSnapshotsTestJSON-1938034567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:34 devstack sudo[87895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.info Feb 27 02:06:34 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:35 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] Created reservations ['5cfd5eb8-2402-458c-bd6b-57c6aa68fc56', 'ef1025f8-c3eb-401f-868a-048eea701ca1', 'e842a0bd-0202-4e1a-9338-b12ace3ee969', '4920a636-ec0d-492f-9f07-c5ffd541c10c'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:35 devstack sudo[87897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:06:35 devstack sudo[87897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:35 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Acquiring lock "cinder-d7d9417a-5688-4631-920a-ce46b2dc02bb-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:35 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Lock "cinder-d7d9417a-5688-4631-920a-ce46b2dc02bb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:35 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Acquiring lock "cinder-quobyte-d7d9417a-5688-4631-920a-ce46b2dc02bb" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:35 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Lock "cinder-quobyte-d7d9417a-5688-4631-920a-ce46b2dc02bb" acquired by "delete_volume" :: waited 0.021s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:35 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4777215a-f5b0-4b44-8cca-f91517bf064f]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d7d9417a-5688-4631-920a-ce46b2dc02bb {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:35 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d7d9417a-5688-4631-920a-ce46b2dc02bb Feb 27 02:06:35 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:35 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-9dcf5056-16c6-43e3-a29a-963f07b5545a req-51577ec9-75b2-45d1-97d4-904dedd54282 tempest-VolumesSnapshotsTestJSON-1938034567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.info" returned: 0 in 1.039s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:35 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [req-9dcf5056-16c6-43e3-a29a-963f07b5545a req-51577ec9-75b2-45d1-97d4-904dedd54282 tempest-VolumesSnapshotsTestJSON-1938034567 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.info is being set with open permissions: ugo+rw Feb 27 02:06:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-9dcf5056-16c6-43e3-a29a-963f07b5545a req-51577ec9-75b2-45d1-97d4-904dedd54282 tempest-VolumesSnapshotsTestJSON-1938034567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:36 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.info Feb 27 02:06:36 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:36 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d7d9417a-5688-4631-920a-ce46b2dc02bb" returned: 0 in 1.019s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d7d9417a-5688-4631-920a-ce46b2dc02bb {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:36 devstack sudo[87897]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 1.405s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:36 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:36 devstack sudo[87909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d7d9417a-5688-4631-920a-ce46b2dc02bb Feb 27 02:06:36 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:36 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] Deleted volume successfully. Feb 27 02:06:36 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-eebf7cd6-36ed-44cc-b123-0800d16f4d21 tempest-VolumesCloneTest-369735363 None] Lock "cinder-06688986-2298-47d3-8554-751c634b7ae9-delete_volume" released by "delete_volume" :: held 3.306s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-fd9a1b80-c0f8-4a53-893b-031057738374 tempest-VolumesActionsTest-1549391068 None] Acquiring lock "cinder-0f77134b-e0c9-4e20-b3c3-bce93b955c55" by "attach_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-fd9a1b80-c0f8-4a53-893b-031057738374 tempest-VolumesActionsTest-1549391068 None] Lock "cinder-0f77134b-e0c9-4e20-b3c3-bce93b955c55" acquired by "attach_volume" :: waited 0.016s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:37 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-fd9a1b80-c0f8-4a53-893b-031057738374 tempest-VolumesActionsTest-1549391068 None] Attaching volume 0f77134b-e0c9-4e20-b3c3-bce93b955c55 to instance 63639b05-4245-4196-b8ac-cccea3e0617c at mountpoint /dev/vdb on host None. Feb 27 02:06:37 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d7d9417a-5688-4631-920a-ce46b2dc02bb" returned: 0 in 0.635s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Lock "cinder-quobyte-d7d9417a-5688-4631-920a-ce46b2dc02bb" released by "delete_volume" :: held 1.696s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:37 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-fd9a1b80-c0f8-4a53-893b-031057738374 tempest-VolumesActionsTest-1549391068 None] Attach volume completed successfully. Feb 27 02:06:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-fd9a1b80-c0f8-4a53-893b-031057738374 tempest-VolumesActionsTest-1549391068 None] Lock "cinder-0f77134b-e0c9-4e20-b3c3-bce93b955c55" released by "attach_volume" :: held 0.198s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:37 devstack cinder-volume[83231]: WARNING cinder.quota [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:06:37 devstack cinder-volume[83231]: WARNING cinder.quota [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:06:37 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-9dcf5056-16c6-43e3-a29a-963f07b5545a req-51577ec9-75b2-45d1-97d4-904dedd54282 tempest-VolumesSnapshotsTestJSON-1938034567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.info" returned: 0 in 1.250s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-9dcf5056-16c6-43e3-a29a-963f07b5545a req-51577ec9-75b2-45d1-97d4-904dedd54282 tempest-VolumesSnapshotsTestJSON-1938034567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.942s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:37 devstack cinder-volume[83231]: INFO cinder.volume.manager [req-9dcf5056-16c6-43e3-a29a-963f07b5545a req-51577ec9-75b2-45d1-97d4-904dedd54282 tempest-VolumesSnapshotsTestJSON-1938034567 None] Create snapshot completed successfully Feb 27 02:06:37 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Created reservations ['20b13f94-528f-4a2b-bc54-4617e14da6f4', 'c714d47d-dc55-481c-838f-f11eade5f5c9', '23a8988a-5744-4eb8-86dc-7f25b24e02f9', 'eb36fc96-39f9-488d-ad1e-4ff763beffca'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:37 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:06:37 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-f02ffd7c-87fc-4318-aaf8-a36f90058427 tempest-VolumesActionsTest-1549391068 None] Acquiring lock "cinder-0f77134b-e0c9-4e20-b3c3-bce93b955c55-detach_volume" by "detach_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-f02ffd7c-87fc-4318-aaf8-a36f90058427 tempest-VolumesActionsTest-1549391068 None] Lock "cinder-0f77134b-e0c9-4e20-b3c3-bce93b955c55-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:37 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-f02ffd7c-87fc-4318-aaf8-a36f90058427 tempest-VolumesActionsTest-1549391068 None] Detaching volume 0f77134b-e0c9-4e20-b3c3-bce93b955c55 from instance 63639b05-4245-4196-b8ac-cccea3e0617c. Feb 27 02:06:37 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-f02ffd7c-87fc-4318-aaf8-a36f90058427 tempest-VolumesActionsTest-1549391068 None] Detach volume completed successfully. Feb 27 02:06:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-f02ffd7c-87fc-4318-aaf8-a36f90058427 tempest-VolumesActionsTest-1549391068 None] Lock "cinder-0f77134b-e0c9-4e20-b3c3-bce93b955c55-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:38 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.724s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:38 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:38 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Deleted volume successfully. Feb 27 02:06:38 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-50246937-344f-4c86-a420-dd1a06e4f5e6 tempest-VolumeRetypeWithoutMigrationTest-16226366 None] Lock "cinder-d7d9417a-5688-4631-920a-ce46b2dc02bb-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:38 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] Acquiring lock "cinder-f05bad10-48c7-45be-af79-4f928bc92802-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:38 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] Lock "cinder-f05bad10-48c7-45be-af79-4f928bc92802-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:38 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] Acquiring lock "cinder-quobyte-966e1651-be7c-41f7-b131-593399464b36" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:38 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] Lock "cinder-quobyte-966e1651-be7c-41f7-b131-593399464b36" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:38 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] Acquiring lock "cinder-quobyte-f05bad10-48c7-45be-af79-4f928bc92802" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:38 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] Lock "cinder-quobyte-f05bad10-48c7-45be-af79-4f928bc92802" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:38 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] Deleting offline snapshot f05bad10-48c7-45be-af79-4f928bc92802 of volume 966e1651-be7c-41f7-b131-593399464b36 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:06:38 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] snapshot_file for this snap is: volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:06:38 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7ec6c7-e241-48e9-b513-7c44ff462338]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:38 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802 Feb 27 02:06:38 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Flow 'volume_create_manager' (88ab5e3a-b4fe-4203-816d-313022f721f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3b9742-3386-47fb-b2a7-f30497dee30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3b9742-3386-47fb-b2a7-f30497dee30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-599942245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c500c66b-a34d-4ded-aae7-a57ae421592e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='343cf7b0a73e47468de54caeae39e234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:39Z,use_quota=True,user_id='d6ce354ff6a84e01a6d7ad9aa60537c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab1a429-569c-4c72-a501-1c3c85edf045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab1a429-569c-4c72-a501-1c3c85edf045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c073e0c-5c91-4bd3-9c5c-a1c9df2c534b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c073e0c-5c91-4bd3-9c5c-a1c9df2c534b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c500c66b-a34d-4ded-aae7-a57ae421592e', 'volume_name': 'volume-c500c66b-a34d-4ded-aae7-a57ae421592e', 'volume_size': 2}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21c7b74-184c-4942-818d-4565b1b62829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21c7b74-184c-4942-818d-4565b1b62829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0405f1e-65f7-4dc1-8844-0800e874e321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:39 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Volume c500c66b-a34d-4ded-aae7-a57ae421592e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c500c66b-a34d-4ded-aae7-a57ae421592e', 'volume_size': 2} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-599942245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c500c66b-a34d-4ded-aae7-a57ae421592e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='343cf7b0a73e47468de54caeae39e234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:39Z,use_quota=True,user_id='d6ce354ff6a84e01a6d7ad9aa60537c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Creating volume c500c66b-a34d-4ded-aae7-a57ae421592e {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:39 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c500c66b-a34d-4ded-aae7-a57ae421592e 2147483648 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:39 devstack sudo[87921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c500c66b-a34d-4ded-aae7-a57ae421592e 2147483648 Feb 27 02:06:39 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:39 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802" returned: 0 in 0.701s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-966e1651-be7c-41f7-b131-593399464b36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ef4ed8-45e1-484a-9782-a2d0cb66ea59]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:39 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36 Feb 27 02:06:39 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:40 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c500c66b-a34d-4ded-aae7-a57ae421592e 2147483648" returned: 0 in 0.810s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c500c66b-a34d-4ded-aae7-a57ae421592e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:40 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c500c66b-a34d-4ded-aae7-a57ae421592e Feb 27 02:06:40 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:40 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36" returned: 0 in 0.912s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:40 devstack sudo[87955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802 Feb 27 02:06:40 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:40 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c500c66b-a34d-4ded-aae7-a57ae421592e" returned: 0 in 0.696s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:40 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0405f1e-65f7-4dc1-8844-0800e874e321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c500c66b-a34d-4ded-aae7-a57ae421592e', 'volume_size': 2}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80343a2-1846-4086-8b15-5532771f517f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:40 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Volume volume-c500c66b-a34d-4ded-aae7-a57ae421592e (c500c66b-a34d-4ded-aae7-a57ae421592e): created successfully Feb 27 02:06:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80343a2-1846-4086-8b15-5532771f517f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:40 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Flow 'volume_create_manager' (88ab5e3a-b4fe-4203-816d-313022f721f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802" returned: 0 in 0.591s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:41 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-add5b21b-06a7-4f8e-9cb7-b97372ad39cc tempest-VolumesCloneNegativeTest-862746108 None] Created volume successfully. Feb 27 02:06:41 devstack sudo[87962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802 Feb 27 02:06:41 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:41 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] Acquiring lock "cinder-c500c66b-a34d-4ded-aae7-a57ae421592e-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:41 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] Lock "cinder-c500c66b-a34d-4ded-aae7-a57ae421592e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:41 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=143,cinder:INSERT=35,cinder:UPDATE=147,cinder:DELETE=8 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:06:41 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:UPDATE=172,cinder:DELETE=13,cinder:SELECT=139,cinder:INSERT=41 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:06:41 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] Acquiring lock "cinder-quobyte-c500c66b-a34d-4ded-aae7-a57ae421592e" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:41 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] Lock "cinder-quobyte-c500c66b-a34d-4ded-aae7-a57ae421592e" acquired by "delete_volume" :: waited 0.015s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:41 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e8d67a-6cfd-4479-9db2-7bd070d1f2ea]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c500c66b-a34d-4ded-aae7-a57ae421592e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:41 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36.f05bad10-48c7-45be-af79-4f928bc92802" returned: 0 in 0.770s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:41 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] Lock "cinder-quobyte-f05bad10-48c7-45be-af79-4f928bc92802" released by "_delete_snapshot" :: held 3.147s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:41 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] Lock "cinder-quobyte-966e1651-be7c-41f7-b131-593399464b36" released by "delete_snapshot" :: held 3.180s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:41 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c500c66b-a34d-4ded-aae7-a57ae421592e Feb 27 02:06:41 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:41 devstack cinder-volume[83231]: DEBUG cinder.quota [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] Created reservations ['ab8b982e-ed0d-49b0-9891-a5bb28a526f7', '912d8eec-04cd-4f8d-9ae9-2c8d9b8b48fa', 'b8d9cef2-a6b9-4719-b041-922a5e1d76f7', 'e183b4f6-6e25-48e6-86e1-37b1526b3042'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:41 devstack cinder-volume[83231]: INFO cinder.volume.manager [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] Delete snapshot completed successfully. Feb 27 02:06:41 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-52783951-c155-484f-8b58-c6ffba8f75b5 req-c89a2026-19cc-4208-8cb3-463568aea561 tempest-VolumesSnapshotsTestJSON-1938034567 None] Lock "cinder-f05bad10-48c7-45be-af79-4f928bc92802-delete_snapshot" released by "delete_snapshot" :: held 3.358s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:42 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c500c66b-a34d-4ded-aae7-a57ae421592e" returned: 0 in 0.734s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c500c66b-a34d-4ded-aae7-a57ae421592e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:42 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c500c66b-a34d-4ded-aae7-a57ae421592e Feb 27 02:06:42 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:42 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c500c66b-a34d-4ded-aae7-a57ae421592e" returned: 0 in 0.467s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] Lock "cinder-quobyte-c500c66b-a34d-4ded-aae7-a57ae421592e" released by "delete_volume" :: held 1.243s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:42 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] Created reservations ['f98abda3-05dd-40d6-b788-b2e99febb74c', '5d4e2214-8868-4ebf-be8a-be61c229f555', 'f6550803-8acd-4d56-801f-2e03b5bbffcb', '6ef35c5d-a56e-4819-8f0c-16534ced873d'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] Acquiring lock "cinder-966e1651-be7c-41f7-b131-593399464b36-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] Lock "cinder-966e1651-be7c-41f7-b131-593399464b36-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:43 devstack sudo[87978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:06:43 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] Acquiring lock "cinder-quobyte-966e1651-be7c-41f7-b131-593399464b36" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] Lock "cinder-quobyte-966e1651-be7c-41f7-b131-593399464b36" acquired by "delete_volume" :: waited 0.033s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f648c39f-ea43-4079-9711-ba00719e068d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:43 devstack sudo[87980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36 Feb 27 02:06:43 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Flow 'volume_create_manager' (a5f80b5d-b2cb-4439-b452-17e2e90bcc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a58ece-5f32-4476-ac0a-2578ecfeb572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a58ece-5f32-4476-ac0a-2578ecfeb572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1507280558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e480502a-21bf-4869-94e3-3953625c14bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5e4e6e5ba244d59bb7ebd08ce1fbcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:43Z,use_quota=True,user_id='005a82a4e53a423c9dfe863608ad7bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a71ccd5f-dc05-44ce-8ab4-8e7a05694642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a71ccd5f-dc05-44ce-8ab4-8e7a05694642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce12af3-6616-4694-b8ed-b22e9e2d61f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce12af3-6616-4694-b8ed-b22e9e2d61f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e480502a-21bf-4869-94e3-3953625c14bd', 'volume_name': 'volume-e480502a-21bf-4869-94e3-3953625c14bd', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20afcc0-e202-4567-8b43-b7bf60085a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20afcc0-e202-4567-8b43-b7bf60085a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf448672-97ce-4c3d-87fc-ca7c51379648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:43 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Volume e480502a-21bf-4869-94e3-3953625c14bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e480502a-21bf-4869-94e3-3953625c14bd', 'volume_size': 1} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1507280558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e480502a-21bf-4869-94e3-3953625c14bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5e4e6e5ba244d59bb7ebd08ce1fbcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:43Z,use_quota=True,user_id='005a82a4e53a423c9dfe863608ad7bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Creating volume e480502a-21bf-4869-94e3-3953625c14bd {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:43 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:43 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd 1073741824 Feb 27 02:06:43 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:43 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.535s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:43 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] Deleted volume successfully. Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cad2465c-4113-4e63-9514-650364f43564 tempest-VolumesCloneNegativeTest-862746108 None] Lock "cinder-c500c66b-a34d-4ded-aae7-a57ae421592e-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:43 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36" returned: 0 in 0.655s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:43 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36 Feb 27 02:06:43 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:44 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd 1073741824" returned: 0 in 0.630s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:44 devstack sudo[87993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd Feb 27 02:06:44 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:44 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-966e1651-be7c-41f7-b131-593399464b36" returned: 0 in 0.555s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] Lock "cinder-quobyte-966e1651-be7c-41f7-b131-593399464b36" released by "delete_volume" :: held 1.270s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:44 devstack cinder-volume[83231]: DEBUG cinder.quota [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] Created reservations ['2dd03141-3168-4e0e-b559-fb77f7cede46', '16ffe7a0-c8d1-4069-be27-bcccd0ddd490', 'e71881b2-6ce5-4445-9bc1-d421ce0b6594', 'e41261f0-0059-4739-98eb-0d8d365e16dc'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:44 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:44 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:44 devstack sudo[87997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:06:44 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:44 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd" returned: 0 in 0.613s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:44 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf448672-97ce-4c3d-87fc-ca7c51379648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e480502a-21bf-4869-94e3-3953625c14bd', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a99de9-55c3-48f1-972d-e2e6a6aa67fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:44 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Volume volume-e480502a-21bf-4869-94e3-3953625c14bd (e480502a-21bf-4869-94e3-3953625c14bd): created successfully Feb 27 02:06:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a99de9-55c3-48f1-972d-e2e6a6aa67fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Flow 'volume_create_manager' (a5f80b5d-b2cb-4439-b452-17e2e90bcc67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:44 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-94963258-edbe-4014-9572-92baeff7965c tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Created volume successfully. Feb 27 02:06:45 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.569s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:45 devstack cinder-volume[83231]: DEBUG cinder.manager [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:45 devstack cinder-volume[83231]: INFO cinder.volume.manager [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] Deleted volume successfully. Feb 27 02:06:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [req-27071dcb-e1c8-470f-ac41-668400c2e61b req-cc21033d-8397-4d2d-b6f4-7b46719c5f25 tempest-VolumesSnapshotsTestJSON-1938034567 None] Lock "cinder-966e1651-be7c-41f7-b131-593399464b36-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6e9fd555-15a8-40e8-a444-5713f08052d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6e9fd555-15a8-40e8-a444-5713f08052d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-6e9fd555-15a8-40e8-a444-5713f08052d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Creating offline snapshot d738cbda-06a7-45e3-975c-1fad4d56b71e of volume e480502a-21bf-4869-94e3-3953625c14bd {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:06:45 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f73c62-8df6-4789-9636-e2000f8de651]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6e9fd555-15a8-40e8-a444-5713f08052d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:45 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd Feb 27 02:06:45 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:46 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6e9fd555-15a8-40e8-a444-5713f08052d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd" returned: 0 in 0.736s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6e9fd555-15a8-40e8-a444-5713f08052d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:46 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e 1G Feb 27 02:06:46 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:47 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6e9fd555-15a8-40e8-a444-5713f08052d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e 1G" returned: 0 in 0.712s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6e9fd555-15a8-40e8-a444-5713f08052d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e480502a-21bf-4869-94e3-3953625c14bd -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:47 devstack sudo[88010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e480502a-21bf-4869-94e3-3953625c14bd -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e Feb 27 02:06:47 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:47 devstack cinder-volume[83231]: DEBUG oslo_service.periodic_task [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83231) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:06:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:47 devstack sudo[88012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:06:47 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:47 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6e9fd555-15a8-40e8-a444-5713f08052d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e480502a-21bf-4869-94e3-3953625c14bd -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e" returned: 0 in 0.550s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:47 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-6e9fd555-15a8-40e8-a444-5713f08052d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e is being set with open permissions: ugo+rw Feb 27 02:06:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6e9fd555-15a8-40e8-a444-5713f08052d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:47 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e Feb 27 02:06:47 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f6398eb2-7b27-48ea-ba6a-6f5b805ae20d tempest-VolumesActionsTest-1549391068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:47 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.575s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:47 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:48 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6e9fd555-15a8-40e8-a444-5713f08052d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e" returned: 0 in 0.622s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6e9fd555-15a8-40e8-a444-5713f08052d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:48 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.info Feb 27 02:06:48 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:48 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Flow 'volume_create_manager' (aaa46544-5962-4ac0-b742-5e16cc6606df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a027a18a-9ee7-4a38-b159-7930feb794fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a027a18a-9ee7-4a38-b159-7930feb794fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1958391425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c63c2c8-4e07-427e-b18c-2637e535bad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015f3cbc79554fa6ade05b2c2ce4eb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:49Z,use_quota=True,user_id='fb343eacf31f419092477725101fceb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1638bcb3-297f-4634-923f-879ff2dd9f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1638bcb3-297f-4634-923f-879ff2dd9f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badff251-7b31-408f-9812-70c19f2b4747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badff251-7b31-408f-9812-70c19f2b4747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c63c2c8-4e07-427e-b18c-2637e535bad1', 'volume_name': 'volume-9c63c2c8-4e07-427e-b18c-2637e535bad1', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0542fb80-79ad-4712-925f-c692ce7d2712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0542fb80-79ad-4712-925f-c692ce7d2712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de123b7-0363-4dd9-b521-6a512d53b5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:48 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Volume 9c63c2c8-4e07-427e-b18c-2637e535bad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c63c2c8-4e07-427e-b18c-2637e535bad1', 'volume_size': 1} Feb 27 02:06:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:48 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6e9fd555-15a8-40e8-a444-5713f08052d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.info" returned: 0 in 0.583s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:48 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-6e9fd555-15a8-40e8-a444-5713f08052d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.info is being set with open permissions: ugo+rw Feb 27 02:06:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6e9fd555-15a8-40e8-a444-5713f08052d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:48 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.info Feb 27 02:06:48 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:49 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Flow 'volume_create_manager' (5c79aa30-6190-4204-a0b6-543e313c2c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e92016-ac55-4d0c-b969-37dfb3a8ba32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e92016-ac55-4d0c-b969-37dfb3a8ba32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1293896405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7375fec6-476f-40db-8126-b053ec53ee9d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8baae2184fc44599e7af8c162aff862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:49Z,use_quota=True,user_id='348f470a605f4b37865ac468ddf49d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7d0272-a245-4806-9e69-17c0addaba1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7d0272-a245-4806-9e69-17c0addaba1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bcf6a68-2cce-428c-a2c0-d479b9ca54d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bcf6a68-2cce-428c-a2c0-d479b9ca54d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7375fec6-476f-40db-8126-b053ec53ee9d', 'volume_name': 'volume-7375fec6-476f-40db-8126-b053ec53ee9d', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a6ad8f-30cd-4bc0-ad1f-f70f301f887a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a6ad8f-30cd-4bc0-ad1f-f70f301f887a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a0ba60-a7fa-4bb3-a1d6-925b36d38bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:49 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Volume 7375fec6-476f-40db-8126-b053ec53ee9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7375fec6-476f-40db-8126-b053ec53ee9d', 'volume_size': 1} Feb 27 02:06:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:49 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6e9fd555-15a8-40e8-a444-5713f08052d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.info" returned: 0 in 0.523s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6e9fd555-15a8-40e8-a444-5713f08052d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.800s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f6398eb2-7b27-48ea-ba6a-6f5b805ae20d tempest-VolumesActionsTest-1549391068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.705s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:49 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[399b69aa-9a58-4fca-a85d-02e108e129cd]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f6398eb2-7b27-48ea-ba6a-6f5b805ae20d tempest-VolumesActionsTest-1549391068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:49 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-6e9fd555-15a8-40e8-a444-5713f08052d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Create snapshot completed successfully Feb 27 02:06:49 devstack sudo[88027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 Feb 27 02:06:49 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:50 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f6398eb2-7b27-48ea-ba6a-6f5b805ae20d tempest-VolumesActionsTest-1549391068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55" returned: 0 in 0.633s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:50 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f725a4-14f0-48c5-a779-87d5a58cb2b3]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f6398eb2-7b27-48ea-ba6a-6f5b805ae20d tempest-VolumesActionsTest-1549391068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:50 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 Feb 27 02:06:50 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Acquiring lock "cinder-d738cbda-06a7-45e3-975c-1fad4d56b71e-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Lock "cinder-d738cbda-06a7-45e3-975c-1fad4d56b71e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Acquiring lock "cinder-quobyte-e480502a-21bf-4869-94e3-3953625c14bd" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Lock "cinder-quobyte-e480502a-21bf-4869-94e3-3953625c14bd" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Acquiring lock "cinder-quobyte-d738cbda-06a7-45e3-975c-1fad4d56b71e" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Lock "cinder-quobyte-d738cbda-06a7-45e3-975c-1fad4d56b71e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Deleting offline snapshot d738cbda-06a7-45e3-975c-1fad4d56b71e of volume e480502a-21bf-4869-94e3-3953625c14bd {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:06:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] snapshot_file for this snap is: volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:06:50 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[49de9e54-3fc9-4f30-b8b6-aa0b21fd7018]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:50 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e Feb 27 02:06:50 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:50 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f6398eb2-7b27-48ea-ba6a-6f5b805ae20d tempest-VolumesActionsTest-1549391068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55" returned: 0 in 0.635s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f6398eb2-7b27-48ea-ba6a-6f5b805ae20d tempest-VolumesActionsTest-1549391068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 /opt/stack/data/cinder/conversion/0f77134b-e0c9-4e20-b3c3-bce93b955c55.temp_image.a83622d4-e477-4fcc-b3c6-547af6ea9430hfrfm3ko.img {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:50 devstack sudo[88039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 /opt/stack/data/cinder/conversion/0f77134b-e0c9-4e20-b3c3-bce93b955c55.temp_image.a83622d4-e477-4fcc-b3c6-547af6ea9430hfrfm3ko.img Feb 27 02:06:50 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:50 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e" returned: 0 in 0.588s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e480502a-21bf-4869-94e3-3953625c14bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:51 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6583a8bb-c692-4c85-9f5b-4cee2fbdc6e4]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:51 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd Feb 27 02:06:51 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:52 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd" returned: 0 in 1.754s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:52 devstack sudo[88060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e Feb 27 02:06:52 devstack sudo[88060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:52 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f6398eb2-7b27-48ea-ba6a-6f5b805ae20d tempest-VolumesActionsTest-1549391068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 /opt/stack/data/cinder/conversion/0f77134b-e0c9-4e20-b3c3-bce93b955c55.temp_image.a83622d4-e477-4fcc-b3c6-547af6ea9430hfrfm3ko.img" returned: 0 in 2.217s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:52 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a88d74-2615-4e28-b8db-7ef4e84010dc]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f6398eb2-7b27-48ea-ba6a-6f5b805ae20d tempest-VolumesActionsTest-1549391068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:53 devstack sudo[88062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 Feb 27 02:06:53 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:53 devstack sudo[88060]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e" returned: 0 in 0.676s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:53 devstack sudo[88070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e Feb 27 02:06:53 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:53 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f6398eb2-7b27-48ea-ba6a-6f5b805ae20d tempest-VolumesActionsTest-1549391068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55" returned: 0 in 0.675s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:53 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-f6398eb2-7b27-48ea-ba6a-6f5b805ae20d tempest-VolumesActionsTest-1549391068 None] Image conversion details: src /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55, size 1024.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/conversion/0f77134b-e0c9-4e20-b3c3-bce93b955c55.temp_image.a83622d4-e477-4fcc-b3c6-547af6ea9430hfrfm3ko.img {{(pid=83231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:06:53 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-f6398eb2-7b27-48ea-ba6a-6f5b805ae20d tempest-VolumesActionsTest-1549391068 None] Converted 1024.00 MB image at 461.56 MB/s Feb 27 02:06:53 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-f6398eb2-7b27-48ea-ba6a-6f5b805ae20d tempest-VolumesActionsTest-1549391068 None] a83622d4-e477-4fcc-b3c6-547af6ea9430 was raw, no need to convert to raw {{(pid=83231) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Feb 27 02:06:53 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd.d738cbda-06a7-45e3-975c-1fad4d56b71e" returned: 0 in 0.447s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:53 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Lock "cinder-quobyte-d738cbda-06a7-45e3-975c-1fad4d56b71e" released by "_delete_snapshot" :: held 3.554s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:53 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Lock "cinder-quobyte-e480502a-21bf-4869-94e3-3953625c14bd" released by "delete_snapshot" :: held 3.575s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:53 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Created reservations ['100ad941-0f38-4c76-9f32-99dc1d14ebf2', '67d9d587-8d6d-41d5-bbec-dbff40f99a9f', '13001b16-0f14-4686-9151-2df5f11cfb07', 'c96086cd-8346-4aa2-b0c9-9d9a08e50d98'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:54 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Delete snapshot completed successfully. Feb 27 02:06:54 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-06d16a44-e569-4a6b-af54-eb1d7857fde5 tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Lock "cinder-d738cbda-06a7-45e3-975c-1fad4d56b71e-delete_snapshot" released by "delete_snapshot" :: held 3.687s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:54 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Acquiring lock "cinder-e480502a-21bf-4869-94e3-3953625c14bd-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:54 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Lock "cinder-e480502a-21bf-4869-94e3-3953625c14bd-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:54 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Acquiring lock "cinder-quobyte-e480502a-21bf-4869-94e3-3953625c14bd" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:54 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Lock "cinder-quobyte-e480502a-21bf-4869-94e3-3953625c14bd" acquired by "delete_volume" :: waited 0.015s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:54 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dcde43-568f-43ac-b5fd-52a27eaa260f]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:55 devstack sudo[88074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd Feb 27 02:06:55 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:55 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd" returned: 0 in 0.605s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:55 devstack sudo[88079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd Feb 27 02:06:55 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:56 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e480502a-21bf-4869-94e3-3953625c14bd" returned: 0 in 0.497s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:56 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Lock "cinder-quobyte-e480502a-21bf-4869-94e3-3953625c14bd" released by "delete_volume" :: held 1.157s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:56 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Created reservations ['d0404bc5-bc1d-4e67-8dee-611bf1b06764', '3f837f8b-cc44-4593-b27d-87c979e991b8', '20943345-6770-42e9-aa93-c5279712d610', '39934e15-bcdc-47e9-a02a-3b1e87cc1bc8'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:56 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:56 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:56 devstack sudo[88082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:06:56 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:56 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.523s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:56 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:56 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Deleted volume successfully. Feb 27 02:06:56 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-48d36f40-2433-4197-8698-f48020b3dcab tempest-VolumeSnapshotQuotasNegativeTestJSON-795272175 None] Lock "cinder-e480502a-21bf-4869-94e3-3953625c14bd-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f6398eb2-7b27-48ea-ba6a-6f5b805ae20d tempest-VolumesActionsTest-1549391068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.369s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f6398eb2-7b27-48ea-ba6a-6f5b805ae20d tempest-VolumesActionsTest-1549391068 None] Uploaded volume to glance image-id: a83622d4-e477-4fcc-b3c6-547af6ea9430. {{(pid=83231) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 27 02:07:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.020s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1958391425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c63c2c8-4e07-427e-b18c-2637e535bad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015f3cbc79554fa6ade05b2c2ce4eb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:49Z,use_quota=True,user_id='fb343eacf31f419092477725101fceb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Creating volume 9c63c2c8-4e07-427e-b18c-2637e535bad1 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:04 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:07:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:04 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1 1073741824 Feb 27 02:07:04 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:04 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-f6398eb2-7b27-48ea-ba6a-6f5b805ae20d tempest-VolumesActionsTest-1549391068 None] Copy volume to image completed successfully. Feb 27 02:07:05 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1 1073741824" returned: 0 in 0.669s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:05 devstack sudo[88094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1 Feb 27 02:07:05 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:06 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1" returned: 0 in 0.631s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.957s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1293896405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7375fec6-476f-40db-8126-b053ec53ee9d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8baae2184fc44599e7af8c162aff862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:49Z,use_quota=True,user_id='348f470a605f4b37865ac468ddf49d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Creating volume 7375fec6-476f-40db-8126-b053ec53ee9d {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:06 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7375fec6-476f-40db-8126-b053ec53ee9d 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de123b7-0363-4dd9-b521-6a512d53b5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c63c2c8-4e07-427e-b18c-2637e535bad1', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:06 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7375fec6-476f-40db-8126-b053ec53ee9d 1073741824 Feb 27 02:07:06 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e237f94-1f46-490c-adc8-37d5bb682659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:06 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Volume volume-9c63c2c8-4e07-427e-b18c-2637e535bad1 (9c63c2c8-4e07-427e-b18c-2637e535bad1): created successfully Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e237f94-1f46-490c-adc8-37d5bb682659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Flow 'volume_create_manager' (aaa46544-5962-4ac0-b742-5e16cc6606df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:06 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-f262c819-8a9b-4fc4-aa65-3db05c6ee51e tempest-VolumesSnapshotListTestJSON-472945567 None] Created volume successfully. Feb 27 02:07:06 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7375fec6-476f-40db-8126-b053ec53ee9d 1073741824" returned: 0 in 0.733s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7375fec6-476f-40db-8126-b053ec53ee9d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:07 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7375fec6-476f-40db-8126-b053ec53ee9d Feb 27 02:07:07 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-01b42e57-3cd0-471f-bb52-5d1025a31cc8 tempest-VolumesSnapshotListTestJSON-472945567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:07 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7375fec6-476f-40db-8126-b053ec53ee9d" returned: 0 in 0.621s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.520s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a0ba60-a7fa-4bb3-a1d6-925b36d38bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7375fec6-476f-40db-8126-b053ec53ee9d', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d423055-3df7-41ca-9b71-969c256c970a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:07 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff4420a-ab51-4805-9aa9-3122c839088b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:07 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Volume volume-7375fec6-476f-40db-8126-b053ec53ee9d (7375fec6-476f-40db-8126-b053ec53ee9d): created successfully Feb 27 02:07:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d423055-3df7-41ca-9b71-969c256c970a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Flow 'volume_create_manager' (5c79aa30-6190-4204-a0b6-543e313c2c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:07 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-d6cdd6ff-4a14-474e-8bc1-58340b48a6b2 tempest-VolumesTestJSON-54115757 None] Created volume successfully. Feb 27 02:07:07 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 Feb 27 02:07:07 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:08 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55" returned: 0 in 0.597s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:08 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[902f61aa-8233-41bd-9679-b44f8b8b8bf1]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:08 devstack sudo[88111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 Feb 27 02:07:08 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:08 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Flow 'volume_create_manager' (b336b50b-01a4-47af-829d-e505b0402b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc5022b-4dd5-448e-8bb2-eab05a1ef439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc5022b-4dd5-448e-8bb2-eab05a1ef439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-208993147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8926765b-8ce0-45fd-ae11-07b00a2ef666,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8baae2184fc44599e7af8c162aff862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:09Z,use_quota=True,user_id='348f470a605f4b37865ac468ddf49d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a4b85d-8c33-430f-a081-d0740a2aa019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a4b85d-8c33-430f-a081-d0740a2aa019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d956d8ca-5e84-4d68-b990-258853c70f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d956d8ca-5e84-4d68-b990-258853c70f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8926765b-8ce0-45fd-ae11-07b00a2ef666', 'volume_name': 'volume-8926765b-8ce0-45fd-ae11-07b00a2ef666', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08e21f3-0ddf-4508-b060-fe11c4c321cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08e21f3-0ddf-4508-b060-fe11c4c321cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab306fa6-c27b-4bc3-87ad-8782721c7ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:08 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Volume 8926765b-8ce0-45fd-ae11-07b00a2ef666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8926765b-8ce0-45fd-ae11-07b00a2ef666', 'volume_size': 1} Feb 27 02:07:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:08 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55" returned: 0 in 0.663s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 /opt/stack/data/cinder/conversion/0f77134b-e0c9-4e20-b3c3-bce93b955c55.temp_image.a0fe429b-2a38-43a4-a40b-613299b0cd760puvltx4.img {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:08 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 /opt/stack/data/cinder/conversion/0f77134b-e0c9-4e20-b3c3-bce93b955c55.temp_image.a0fe429b-2a38-43a4-a40b-613299b0cd760puvltx4.img Feb 27 02:07:08 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:11 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 /opt/stack/data/cinder/conversion/0f77134b-e0c9-4e20-b3c3-bce93b955c55.temp_image.a0fe429b-2a38-43a4-a40b-613299b0cd760puvltx4.img" returned: 0 in 2.506s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:11 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31304af-e03d-4a3f-8435-24127a2f67cc]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:11 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 Feb 27 02:07:11 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:12 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55" returned: 0 in 0.720s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:12 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] Image conversion details: src /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55, size 1024.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/conversion/0f77134b-e0c9-4e20-b3c3-bce93b955c55.temp_image.a0fe429b-2a38-43a4-a40b-613299b0cd760puvltx4.img {{(pid=83231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:07:12 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] Converted 1024.00 MB image at 408.28 MB/s Feb 27 02:07:12 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] a0fe429b-2a38-43a4-a40b-613299b0cd76 was raw, converting to qcow2 {{(pid=83231) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Feb 27 02:07:12 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d1943e-8f5d-4166-b523-5c5cdd68e852]: (4, 'raw') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0f77134b-e0c9-4e20-b3c3-bce93b955c55.temp_image.a0fe429b-2a38-43a4-a40b-613299b0cd760puvltx4.img {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:12 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0f77134b-e0c9-4e20-b3c3-bce93b955c55.temp_image.a0fe429b-2a38-43a4-a40b-613299b0cd760puvltx4.img Feb 27 02:07:12 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:12 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0f77134b-e0c9-4e20-b3c3-bce93b955c55.temp_image.a0fe429b-2a38-43a4-a40b-613299b0cd760puvltx4.img" returned: 0 in 0.638s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0f77134b-e0c9-4e20-b3c3-bce93b955c55.temp_image.a0fe429b-2a38-43a4-a40b-613299b0cd760puvltx4.img {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:12 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0f77134b-e0c9-4e20-b3c3-bce93b955c55.temp_image.a0fe429b-2a38-43a4-a40b-613299b0cd760puvltx4.img Feb 27 02:07:12 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:13 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0f77134b-e0c9-4e20-b3c3-bce93b955c55.temp_image.a0fe429b-2a38-43a4-a40b-613299b0cd760puvltx4.img" returned: 1 in 0.629s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0f77134b-e0c9-4e20-b3c3-bce93b955c55.temp_image.a0fe429b-2a38-43a4-a40b-613299b0cd760puvltx4.img' failed. Not Retrying. {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:07:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0f77134b-e0c9-4e20-b3c3-bce93b955c55.temp_image.a0fe429b-2a38-43a4-a40b-613299b0cd760puvltx4.img /opt/stack/data/cinder/conversion/vol_upload_ys6av7sw {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:13 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0f77134b-e0c9-4e20-b3c3-bce93b955c55.temp_image.a0fe429b-2a38-43a4-a40b-613299b0cd760puvltx4.img /opt/stack/data/cinder/conversion/vol_upload_ys6av7sw Feb 27 02:07:13 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:14 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0f77134b-e0c9-4e20-b3c3-bce93b955c55.temp_image.a0fe429b-2a38-43a4-a40b-613299b0cd760puvltx4.img /opt/stack/data/cinder/conversion/vol_upload_ys6av7sw" returned: 0 in 0.577s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:14 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] Image conversion details: src /opt/stack/data/cinder/conversion/0f77134b-e0c9-4e20-b3c3-bce93b955c55.temp_image.a0fe429b-2a38-43a4-a40b-613299b0cd760puvltx4.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ys6av7sw {{(pid=83231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:07:14 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] Converted 1024.00 MB image at 1024.00 MB/s Feb 27 02:07:14 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a7caee-aca6-4aa7-b673-f6cd85f1a8f2]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ys6av7sw {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:14 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ys6av7sw Feb 27 02:07:14 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:14 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ys6av7sw" returned: 0 in 0.664s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.269s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] Uploaded volume to glance image-id: a0fe429b-2a38-43a4-a40b-613299b0cd76. {{(pid=83231) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 27 02:07:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-01b42e57-3cd0-471f-bb52-5d1025a31cc8 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.689s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-01b42e57-3cd0-471f-bb52-5d1025a31cc8 tempest-VolumesSnapshotListTestJSON-472945567 None] Creating offline snapshot c9b0f0ac-db98-481b-83d6-4f798d8a7747 of volume 9c63c2c8-4e07-427e-b18c-2637e535bad1 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:15 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b167ea09-6fc3-43a3-b607-9d36f7e35252 tempest-VolumesActionsTest-1549391068 None] Copy volume to image completed successfully. Feb 27 02:07:15 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[03625daf-d3cc-4845-b487-654de20871f0]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-01b42e57-3cd0-471f-bb52-5d1025a31cc8 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:15 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1 Feb 27 02:07:15 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:16 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-01b42e57-3cd0-471f-bb52-5d1025a31cc8 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1" returned: 0 in 0.612s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-01b42e57-3cd0-471f-bb52-5d1025a31cc8 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:16 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 1G Feb 27 02:07:16 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:17 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] Acquiring lock "cinder-0f77134b-e0c9-4e20-b3c3-bce93b955c55-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:17 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] Lock "cinder-0f77134b-e0c9-4e20-b3c3-bce93b955c55-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:17 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-01b42e57-3cd0-471f-bb52-5d1025a31cc8 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 1G" returned: 0 in 0.708s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-01b42e57-3cd0-471f-bb52-5d1025a31cc8 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c63c2c8-4e07-427e-b18c-2637e535bad1 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:17 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] Acquiring lock "cinder-quobyte-0f77134b-e0c9-4e20-b3c3-bce93b955c55" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:17 devstack sudo[88169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c63c2c8-4e07-427e-b18c-2637e535bad1 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 Feb 27 02:07:17 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:17 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] Lock "cinder-quobyte-0f77134b-e0c9-4e20-b3c3-bce93b955c55" acquired by "delete_volume" :: waited 0.012s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:17 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d1ca93-961e-4d48-97a3-c8d856aa3210]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:17 devstack sudo[88171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 Feb 27 02:07:17 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:17 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-01b42e57-3cd0-471f-bb52-5d1025a31cc8 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c63c2c8-4e07-427e-b18c-2637e535bad1 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747" returned: 0 in 0.638s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:17 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-01b42e57-3cd0-471f-bb52-5d1025a31cc8 tempest-VolumesSnapshotListTestJSON-472945567 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 is being set with open permissions: ugo+rw Feb 27 02:07:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-01b42e57-3cd0-471f-bb52-5d1025a31cc8 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:17 devstack sudo[88178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 Feb 27 02:07:17 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:17 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55" returned: 0 in 0.664s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:18 devstack sudo[88181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55 Feb 27 02:07:18 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:18 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-01b42e57-3cd0-471f-bb52-5d1025a31cc8 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747" returned: 0 in 0.511s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-01b42e57-3cd0-471f-bb52-5d1025a31cc8 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:18 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.info Feb 27 02:07:18 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:18 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f77134b-e0c9-4e20-b3c3-bce93b955c55" returned: 0 in 0.525s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:18 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] Lock "cinder-quobyte-0f77134b-e0c9-4e20-b3c3-bce93b955c55" released by "delete_volume" :: held 1.239s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:18 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] Created reservations ['fa834b34-4dac-45cc-9da6-1e748503a51e', 'e29ee57f-e698-441a-b584-0446a92d143b', '5c0fbb6a-a063-44bc-bbf1-71cab0daad59', 'bdd081d9-5271-4fd3-99fe-a94dc8d6d62d'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:18 devstack sudo[88187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:07:18 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:19 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-01b42e57-3cd0-471f-bb52-5d1025a31cc8 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.info" returned: 0 in 0.606s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:19 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-01b42e57-3cd0-471f-bb52-5d1025a31cc8 tempest-VolumesSnapshotListTestJSON-472945567 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.info is being set with open permissions: ugo+rw Feb 27 02:07:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-01b42e57-3cd0-471f-bb52-5d1025a31cc8 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:19 devstack sudo[88190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.info Feb 27 02:07:19 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:19 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.587s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:19 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:19 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] Deleted volume successfully. Feb 27 02:07:19 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8dc0e236-9c66-4f05-9e91-b781f5a902d4 tempest-VolumesActionsTest-1549391068 None] Lock "cinder-0f77134b-e0c9-4e20-b3c3-bce93b955c55-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:19 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-01b42e57-3cd0-471f-bb52-5d1025a31cc8 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.info" returned: 0 in 0.466s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-01b42e57-3cd0-471f-bb52-5d1025a31cc8 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.607s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.711s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-208993147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8926765b-8ce0-45fd-ae11-07b00a2ef666,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8baae2184fc44599e7af8c162aff862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:09Z,use_quota=True,user_id='348f470a605f4b37865ac468ddf49d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Creating volume 8926765b-8ce0-45fd-ae11-07b00a2ef666 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:19 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:07:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8926765b-8ce0-45fd-ae11-07b00a2ef666 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:19 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-01b42e57-3cd0-471f-bb52-5d1025a31cc8 tempest-VolumesSnapshotListTestJSON-472945567 None] Create snapshot completed successfully Feb 27 02:07:19 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8926765b-8ce0-45fd-ae11-07b00a2ef666 1073741824 Feb 27 02:07:19 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c66f8b51-2296-44b9-9462-5690802b44d7 tempest-VolumesSnapshotListTestJSON-472945567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:20 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8926765b-8ce0-45fd-ae11-07b00a2ef666 1073741824" returned: 0 in 1.030s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8926765b-8ce0-45fd-ae11-07b00a2ef666 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:20 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8926765b-8ce0-45fd-ae11-07b00a2ef666 Feb 27 02:07:20 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:21 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8926765b-8ce0-45fd-ae11-07b00a2ef666" returned: 0 in 0.703s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:21 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c66f8b51-2296-44b9-9462-5690802b44d7 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.444s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:21 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab306fa6-c27b-4bc3-87ad-8782721c7ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8926765b-8ce0-45fd-ae11-07b00a2ef666', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:21 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcd1557-ac80-4706-90c7-22f62e7e8899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:21 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-c66f8b51-2296-44b9-9462-5690802b44d7 tempest-VolumesSnapshotListTestJSON-472945567 None] Creating offline snapshot fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 of volume 9c63c2c8-4e07-427e-b18c-2637e535bad1 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:21 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Volume volume-8926765b-8ce0-45fd-ae11-07b00a2ef666 (8926765b-8ce0-45fd-ae11-07b00a2ef666): created successfully Feb 27 02:07:21 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcd1557-ac80-4706-90c7-22f62e7e8899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:21 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Flow 'volume_create_manager' (b336b50b-01a4-47af-829d-e505b0402b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:21 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6596be-700c-4043-9876-e7ce5c0e42c7]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c66f8b51-2296-44b9-9462-5690802b44d7 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:21 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-7f1229dd-a26d-4e2d-b60f-8da129539205 tempest-VolumesTestJSON-54115757 None] Created volume successfully. Feb 27 02:07:21 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 Feb 27 02:07:21 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:22 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c66f8b51-2296-44b9-9462-5690802b44d7 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747" returned: 0 in 0.758s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:22 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-c66f8b51-2296-44b9-9462-5690802b44d7 tempest-VolumesSnapshotListTestJSON-472945567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c63c2c8-4e07-427e-b18c-2637e535bad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c66f8b51-2296-44b9-9462-5690802b44d7 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:22 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 1G Feb 27 02:07:22 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:22 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Flow 'volume_create_manager' (876c4c49-b99b-4002-87f8-3b0a48b9caab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6843a570-dd98-4fd5-82a7-611d34a47ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6843a570-dd98-4fd5-82a7-611d34a47ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-301632809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b9235f-e84a-4083-8a06-0e638a2f3b9b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8baae2184fc44599e7af8c162aff862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:22Z,use_quota=True,user_id='348f470a605f4b37865ac468ddf49d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef39578-9b54-4670-a330-edbf5c1be02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef39578-9b54-4670-a330-edbf5c1be02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdc304b-9624-4f87-be7e-780967632c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdc304b-9624-4f87-be7e-780967632c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b9235f-e84a-4083-8a06-0e638a2f3b9b', 'volume_name': 'volume-d3b9235f-e84a-4083-8a06-0e638a2f3b9b', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93da7198-7405-4bdf-9106-bfa03d08cc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93da7198-7405-4bdf-9106-bfa03d08cc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5714c675-a65f-451f-9f95-8d9fa8122ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Volume d3b9235f-e84a-4083-8a06-0e638a2f3b9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b9235f-e84a-4083-8a06-0e638a2f3b9b', 'volume_size': 1} Feb 27 02:07:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:22 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c66f8b51-2296-44b9-9462-5690802b44d7 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 1G" returned: 0 in 0.677s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c66f8b51-2296-44b9-9462-5690802b44d7 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:22 devstack sudo[88250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 Feb 27 02:07:22 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:23 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c66f8b51-2296-44b9-9462-5690802b44d7 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43" returned: 0 in 0.624s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:23 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-c66f8b51-2296-44b9-9462-5690802b44d7 tempest-VolumesSnapshotListTestJSON-472945567 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 is being set with open permissions: ugo+rw Feb 27 02:07:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c66f8b51-2296-44b9-9462-5690802b44d7 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:23 devstack sudo[88256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 Feb 27 02:07:23 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:23 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c66f8b51-2296-44b9-9462-5690802b44d7 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43" returned: 0 in 0.486s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c66f8b51-2296-44b9-9462-5690802b44d7 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.670s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.606s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-301632809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b9235f-e84a-4083-8a06-0e638a2f3b9b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8baae2184fc44599e7af8c162aff862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:22Z,use_quota=True,user_id='348f470a605f4b37865ac468ddf49d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Creating volume d3b9235f-e84a-4083-8a06-0e638a2f3b9b {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:23 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:07:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d3b9235f-e84a-4083-8a06-0e638a2f3b9b 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:23 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d3b9235f-e84a-4083-8a06-0e638a2f3b9b 1073741824 Feb 27 02:07:23 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:24 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-c66f8b51-2296-44b9-9462-5690802b44d7 tempest-VolumesSnapshotListTestJSON-472945567 None] Create snapshot completed successfully Feb 27 02:07:24 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d3b9235f-e84a-4083-8a06-0e638a2f3b9b 1073741824" returned: 0 in 0.641s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d3b9235f-e84a-4083-8a06-0e638a2f3b9b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:24 devstack sudo[88264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d3b9235f-e84a-4083-8a06-0e638a2f3b9b Feb 27 02:07:24 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Flow 'volume_create_manager' (c3a00e87-1175-49f0-aa05-bcf8bdabe33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c10f4d-99f7-41d7-807f-931132170cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:25 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c10f4d-99f7-41d7-807f-931132170cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-947263488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b79603b0-e1db-4969-80d6-18a8bc8a8998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2fb913d5bce4960a6c74737c255d3f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:25Z,use_quota=True,user_id='7f0afd7ab44241f7b654b69db5809ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2a6a56-3cbd-4cbf-a6a9-9e4c60dae3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2a6a56-3cbd-4cbf-a6a9-9e4c60dae3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53192cd3-3dac-4ec2-a1c3-b23497557706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53192cd3-3dac-4ec2-a1c3-b23497557706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b79603b0-e1db-4969-80d6-18a8bc8a8998', 'volume_name': 'volume-b79603b0-e1db-4969-80d6-18a8bc8a8998', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da05dd7e-0a0a-4226-8a2d-4319c22a7fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da05dd7e-0a0a-4226-8a2d-4319c22a7fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22196d2b-b6c0-4456-98ba-f4b102379c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:25 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Volume b79603b0-e1db-4969-80d6-18a8bc8a8998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b79603b0-e1db-4969-80d6-18a8bc8a8998', 'volume_size': 1} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d3b9235f-e84a-4083-8a06-0e638a2f3b9b" returned: 0 in 0.654s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-947263488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b79603b0-e1db-4969-80d6-18a8bc8a8998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2fb913d5bce4960a6c74737c255d3f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:25Z,use_quota=True,user_id='7f0afd7ab44241f7b654b69db5809ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Creating volume b79603b0-e1db-4969-80d6-18a8bc8a8998 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:25 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b79603b0-e1db-4969-80d6-18a8bc8a8998 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:25 devstack sudo[88267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b79603b0-e1db-4969-80d6-18a8bc8a8998 1073741824 Feb 27 02:07:25 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5714c675-a65f-451f-9f95-8d9fa8122ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b9235f-e84a-4083-8a06-0e638a2f3b9b', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b69592-3bb3-4434-83d2-98b0d5f691c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-3587f3dd-0905-418f-ac74-4d4808ac4808 tempest-VolumesSnapshotListTestJSON-472945567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:25 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Volume volume-d3b9235f-e84a-4083-8a06-0e638a2f3b9b (d3b9235f-e84a-4083-8a06-0e638a2f3b9b): created successfully Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b69592-3bb3-4434-83d2-98b0d5f691c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Flow 'volume_create_manager' (876c4c49-b99b-4002-87f8-3b0a48b9caab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:25 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-eea06442-ae3e-4030-973f-be05452eeef3 tempest-VolumesTestJSON-54115757 None] Created volume successfully. Feb 27 02:07:25 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b79603b0-e1db-4969-80d6-18a8bc8a8998 1073741824" returned: 0 in 0.524s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b79603b0-e1db-4969-80d6-18a8bc8a8998 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:25 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b79603b0-e1db-4969-80d6-18a8bc8a8998 Feb 27 02:07:25 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:26 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b79603b0-e1db-4969-80d6-18a8bc8a8998" returned: 0 in 0.459s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:26 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-3587f3dd-0905-418f-ac74-4d4808ac4808 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.978s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22196d2b-b6c0-4456-98ba-f4b102379c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b79603b0-e1db-4969-80d6-18a8bc8a8998', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e03098-5a34-4f0b-acee-73d8719c4e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:26 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Volume volume-b79603b0-e1db-4969-80d6-18a8bc8a8998 (b79603b0-e1db-4969-80d6-18a8bc8a8998): created successfully Feb 27 02:07:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e03098-5a34-4f0b-acee-73d8719c4e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Flow 'volume_create_manager' (c3a00e87-1175-49f0-aa05-bcf8bdabe33d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:26 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-3587f3dd-0905-418f-ac74-4d4808ac4808 tempest-VolumesSnapshotListTestJSON-472945567 None] Creating offline snapshot 54c98809-9522-4e82-bd85-a6ec4bae92cd of volume 9c63c2c8-4e07-427e-b18c-2637e535bad1 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:26 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-92a33eca-1f5e-4c73-af98-8e00ac53c38d tempest-VolumesNegativeTest-49663951 None] Created volume successfully. Feb 27 02:07:26 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ee5bcb-9caa-4d01-9f50-ca54dda79c08]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3587f3dd-0905-418f-ac74-4d4808ac4808 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:26 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 Feb 27 02:07:26 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:27 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3587f3dd-0905-418f-ac74-4d4808ac4808 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43" returned: 0 in 0.627s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:27 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-3587f3dd-0905-418f-ac74-4d4808ac4808 tempest-VolumesSnapshotListTestJSON-472945567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c63c2c8-4e07-427e-b18c-2637e535bad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3587f3dd-0905-418f-ac74-4d4808ac4808 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:27 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd 1G Feb 27 02:07:27 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] Acquiring lock "cinder-d3b9235f-e84a-4083-8a06-0e638a2f3b9b-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] Lock "cinder-d3b9235f-e84a-4083-8a06-0e638a2f3b9b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] Acquiring lock "cinder-quobyte-d3b9235f-e84a-4083-8a06-0e638a2f3b9b" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] Lock "cinder-quobyte-d3b9235f-e84a-4083-8a06-0e638a2f3b9b" acquired by "delete_volume" :: waited 0.019s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:27 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[af36207b-60f7-4b62-893b-3ec150587e6d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d3b9235f-e84a-4083-8a06-0e638a2f3b9b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:27 devstack sudo[88282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d3b9235f-e84a-4083-8a06-0e638a2f3b9b Feb 27 02:07:27 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:27 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3587f3dd-0905-418f-ac74-4d4808ac4808 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd 1G" returned: 0 in 0.939s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3587f3dd-0905-418f-ac74-4d4808ac4808 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:27 devstack sudo[88287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd Feb 27 02:07:27 devstack sudo[88287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:28 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d3b9235f-e84a-4083-8a06-0e638a2f3b9b" returned: 0 in 0.975s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d3b9235f-e84a-4083-8a06-0e638a2f3b9b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:28 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d3b9235f-e84a-4083-8a06-0e638a2f3b9b Feb 27 02:07:28 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:28 devstack sudo[88287]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3587f3dd-0905-418f-ac74-4d4808ac4808 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd" returned: 0 in 0.893s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:28 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-3587f3dd-0905-418f-ac74-4d4808ac4808 tempest-VolumesSnapshotListTestJSON-472945567 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd is being set with open permissions: ugo+rw Feb 27 02:07:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3587f3dd-0905-418f-ac74-4d4808ac4808 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:28 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd Feb 27 02:07:28 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:28 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d3b9235f-e84a-4083-8a06-0e638a2f3b9b" returned: 0 in 0.752s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] Lock "cinder-quobyte-d3b9235f-e84a-4083-8a06-0e638a2f3b9b" released by "delete_volume" :: held 1.774s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:29 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] Created reservations ['d0452e7e-cb99-46b9-865b-5858ad076f2b', '5c4040ee-e669-41e8-a055-f0585604017e', '32756a68-1cba-4329-ab0d-fb1dca3e9f75', '3bc0c5f3-f5fe-452f-9e19-55c781fa9010'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:29 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:07:29 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:29 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3587f3dd-0905-418f-ac74-4d4808ac4808 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd" returned: 0 in 0.624s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-3587f3dd-0905-418f-ac74-4d4808ac4808 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.191s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] Acquiring lock "cinder-8926765b-8ce0-45fd-ae11-07b00a2ef666-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:29 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-3587f3dd-0905-418f-ac74-4d4808ac4808 tempest-VolumesSnapshotListTestJSON-472945567 None] Create snapshot completed successfully Feb 27 02:07:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] Lock "cinder-8926765b-8ce0-45fd-ae11-07b00a2ef666-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] Acquiring lock "cinder-quobyte-8926765b-8ce0-45fd-ae11-07b00a2ef666" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] Lock "cinder-quobyte-8926765b-8ce0-45fd-ae11-07b00a2ef666" acquired by "delete_volume" :: waited 0.025s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:29 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[779a470c-a1ed-4ab2-8b64-523eb5bed0bb]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8926765b-8ce0-45fd-ae11-07b00a2ef666 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:29 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8926765b-8ce0-45fd-ae11-07b00a2ef666 Feb 27 02:07:29 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:29 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.753s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:29 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:29 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] Deleted volume successfully. Feb 27 02:07:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-96861541-0bd7-46c2-a8a3-99693959f5b5 tempest-VolumesTestJSON-54115757 None] Lock "cinder-d3b9235f-e84a-4083-8a06-0e638a2f3b9b-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:30 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8926765b-8ce0-45fd-ae11-07b00a2ef666" returned: 0 in 0.641s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8926765b-8ce0-45fd-ae11-07b00a2ef666 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:30 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8926765b-8ce0-45fd-ae11-07b00a2ef666 Feb 27 02:07:30 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:30 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8926765b-8ce0-45fd-ae11-07b00a2ef666" returned: 0 in 0.534s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] Lock "cinder-quobyte-8926765b-8ce0-45fd-ae11-07b00a2ef666" released by "delete_volume" :: held 1.207s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:30 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] Created reservations ['008e36ca-b7e2-4d4b-aa41-2e16462211d5', '5eb66cb1-b086-4377-8063-c4d72101d384', '6ad7fce7-1ce1-491d-aaa0-1a8f1165f252', 'b51c3394-cd43-45c9-baf2-0ece1c2ae55a'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:31 devstack sudo[88330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:07:31 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] Acquiring lock "cinder-54c98809-9522-4e82-bd85-a6ec4bae92cd-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-54c98809-9522-4e82-bd85-a6ec4bae92cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] Acquiring lock "cinder-quobyte-9c63c2c8-4e07-427e-b18c-2637e535bad1" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-quobyte-9c63c2c8-4e07-427e-b18c-2637e535bad1" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] Acquiring lock "cinder-quobyte-54c98809-9522-4e82-bd85-a6ec4bae92cd" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-quobyte-54c98809-9522-4e82-bd85-a6ec4bae92cd" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:31 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] Deleting offline snapshot 54c98809-9522-4e82-bd85-a6ec4bae92cd of volume 9c63c2c8-4e07-427e-b18c-2637e535bad1 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:31 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] snapshot_file for this snap is: volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:31 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55801e9-5f56-4d99-97f1-b4eba7d15c6f]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:31 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.531s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:31 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:31 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] Deleted volume successfully. Feb 27 02:07:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6ada3c76-96b6-4300-a4d9-cca1d3a1e846 tempest-VolumesTestJSON-54115757 None] Lock "cinder-8926765b-8ce0-45fd-ae11-07b00a2ef666-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:31 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd Feb 27 02:07:31 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] Acquiring lock "cinder-7375fec6-476f-40db-8126-b053ec53ee9d-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] Lock "cinder-7375fec6-476f-40db-8126-b053ec53ee9d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] Acquiring lock "cinder-quobyte-7375fec6-476f-40db-8126-b053ec53ee9d" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] Lock "cinder-quobyte-7375fec6-476f-40db-8126-b053ec53ee9d" acquired by "delete_volume" :: waited 0.018s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:31 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[86da8a6c-b6e5-4af4-974a-6835b9df155b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7375fec6-476f-40db-8126-b053ec53ee9d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:31 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7375fec6-476f-40db-8126-b053ec53ee9d Feb 27 02:07:31 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:32 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd" returned: 0 in 0.658s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c63c2c8-4e07-427e-b18c-2637e535bad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:32 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be844e6-d094-4fa6-83c8-27941765f446]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:32 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 Feb 27 02:07:32 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:32 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7375fec6-476f-40db-8126-b053ec53ee9d" returned: 0 in 0.616s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7375fec6-476f-40db-8126-b053ec53ee9d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:32 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7375fec6-476f-40db-8126-b053ec53ee9d Feb 27 02:07:32 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:32 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43" returned: 0 in 0.633s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c63c2c8-4e07-427e-b18c-2637e535bad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:32 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd Feb 27 02:07:32 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:32 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7375fec6-476f-40db-8126-b053ec53ee9d" returned: 0 in 0.560s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] Lock "cinder-quobyte-7375fec6-476f-40db-8126-b053ec53ee9d" released by "delete_volume" :: held 1.208s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:33 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] Created reservations ['0550dc57-5622-484a-8fcf-37d3c35dacc1', '22493e71-a088-459a-a715-2e39aa799e27', '58c2b6fc-18fc-48bc-b919-051350a84c58', '1d87d77c-2a97-43ee-9f80-030b581c4503'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:33 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:33 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:33 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:07:33 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:33 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd" returned: 0 in 0.773s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:33 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd Feb 27 02:07:33 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:33 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.612s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:33 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:33 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] Deleted volume successfully. Feb 27 02:07:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-f735d765-f9a9-463d-b2ec-ad9c6079c033 tempest-VolumesTestJSON-54115757 None] Lock "cinder-7375fec6-476f-40db-8126-b053ec53ee9d-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:34 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.54c98809-9522-4e82-bd85-a6ec4bae92cd" returned: 0 in 0.611s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-quobyte-54c98809-9522-4e82-bd85-a6ec4bae92cd" released by "_delete_snapshot" :: held 2.747s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-quobyte-9c63c2c8-4e07-427e-b18c-2637e535bad1" released by "delete_snapshot" :: held 2.763s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:34 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] Created reservations ['b2509cff-bec2-439d-8e87-d2e8130003d2', '5fa46487-d819-47f8-9921-a041c46e7a75', '8e8e8394-d724-40a9-8827-3348899aceae', '6060f57e-0714-42ec-97ea-f3618b42a7e5'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:34 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] Delete snapshot completed successfully. Feb 27 02:07:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8b402015-561a-4c66-8f45-199c4a3d1028 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-54c98809-9522-4e82-bd85-a6ec4bae92cd-delete_snapshot" released by "delete_snapshot" :: held 3.128s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] Acquiring lock "cinder-fc21cc16-18af-4fe1-a931-5c3fbeb5ec43-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-fc21cc16-18af-4fe1-a931-5c3fbeb5ec43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] Acquiring lock "cinder-quobyte-9c63c2c8-4e07-427e-b18c-2637e535bad1" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-quobyte-9c63c2c8-4e07-427e-b18c-2637e535bad1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] Acquiring lock "cinder-quobyte-fc21cc16-18af-4fe1-a931-5c3fbeb5ec43" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-quobyte-fc21cc16-18af-4fe1-a931-5c3fbeb5ec43" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:34 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] Deleting offline snapshot fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 of volume 9c63c2c8-4e07-427e-b18c-2637e535bad1 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:34 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] snapshot_file for this snap is: volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:34 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[60487ff3-f4f7-41ae-b9c1-e7ce40a8d88f]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:34 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 Feb 27 02:07:34 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:35 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43" returned: 0 in 0.865s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c63c2c8-4e07-427e-b18c-2637e535bad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:35 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5aef02a-dee0-4b9a-b794-12d94ebb8d07]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:35 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 Feb 27 02:07:35 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:36 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747" returned: 0 in 0.806s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:36 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c63c2c8-4e07-427e-b18c-2637e535bad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:36 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 Feb 27 02:07:36 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:37 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43" returned: 0 in 0.668s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:37 devstack sudo[88424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43 Feb 27 02:07:37 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Flow 'volume_create_manager' (14c0325d-1aac-49af-b06a-db244158e5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c719dc-330a-45b7-b92c-3782adce674d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c719dc-330a-45b7-b92c-3782adce674d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-844771925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fc18e2-27fe-47e8-a987-5784091ceaaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4b4a818374673a9e4f1d4de60bc28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:38Z,use_quota=True,user_id='cb656269e31b4ee1be63f048eb13cc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfd0261-552d-4cd3-ae9d-98719331ea25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfd0261-552d-4cd3-ae9d-98719331ea25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0a164f-6c74-4458-9426-016b550019c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0a164f-6c74-4458-9426-016b550019c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79fc18e2-27fe-47e8-a987-5784091ceaaf', 'volume_name': 'volume-79fc18e2-27fe-47e8-a987-5784091ceaaf', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03442621-a664-4e6b-81fd-178d54e7cd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03442621-a664-4e6b-81fd-178d54e7cd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d4d4d7-7f3a-4a4f-afc5-70abb0aa1d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:37 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Volume 79fc18e2-27fe-47e8-a987-5784091ceaaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79fc18e2-27fe-47e8-a987-5784091ceaaf', 'volume_size': 1} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-844771925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fc18e2-27fe-47e8-a987-5784091ceaaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4b4a818374673a9e4f1d4de60bc28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:38Z,use_quota=True,user_id='cb656269e31b4ee1be63f048eb13cc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Creating volume 79fc18e2-27fe-47e8-a987-5784091ceaaf {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:37 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fc18e2-27fe-47e8-a987-5784091ceaaf 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:37 devstack sudo[88427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fc18e2-27fe-47e8-a987-5784091ceaaf 1073741824 Feb 27 02:07:37 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:37 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.fc21cc16-18af-4fe1-a931-5c3fbeb5ec43" returned: 0 in 0.809s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-quobyte-fc21cc16-18af-4fe1-a931-5c3fbeb5ec43" released by "_delete_snapshot" :: held 3.242s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-quobyte-9c63c2c8-4e07-427e-b18c-2637e535bad1" released by "delete_snapshot" :: held 3.268s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:38 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] Created reservations ['3bce38ee-9777-4022-a082-c27300cefbc5', '7252de27-4851-4b66-82be-5dfc68fdf3d0', '9d14348c-378c-41d8-abb2-d3d1441b683b', '9758d0db-e227-4203-8be5-dbb0e049c608'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:38 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] Delete snapshot completed successfully. Feb 27 02:07:38 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1ccc7c51-3d81-4065-bdf8-7adc762d7e16 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-fc21cc16-18af-4fe1-a931-5c3fbeb5ec43-delete_snapshot" released by "delete_snapshot" :: held 3.483s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:38 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fc18e2-27fe-47e8-a987-5784091ceaaf 1073741824" returned: 0 in 0.701s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fc18e2-27fe-47e8-a987-5784091ceaaf {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:38 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fc18e2-27fe-47e8-a987-5784091ceaaf Feb 27 02:07:38 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:38 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] Acquiring lock "cinder-c9b0f0ac-db98-481b-83d6-4f798d8a7747-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-c9b0f0ac-db98-481b-83d6-4f798d8a7747-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] Acquiring lock "cinder-quobyte-9c63c2c8-4e07-427e-b18c-2637e535bad1" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-quobyte-9c63c2c8-4e07-427e-b18c-2637e535bad1" acquired by "delete_snapshot" :: waited 0.037s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] Acquiring lock "cinder-quobyte-c9b0f0ac-db98-481b-83d6-4f798d8a7747" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-quobyte-c9b0f0ac-db98-481b-83d6-4f798d8a7747" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] Deleting offline snapshot c9b0f0ac-db98-481b-83d6-4f798d8a7747 of volume 9c63c2c8-4e07-427e-b18c-2637e535bad1 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] snapshot_file for this snap is: volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c7423f-b3c0-4da4-a694-6127c131c9ec]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:39 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fc18e2-27fe-47e8-a987-5784091ceaaf" returned: 0 in 0.721s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d4d4d7-7f3a-4a4f-afc5-70abb0aa1d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79fc18e2-27fe-47e8-a987-5784091ceaaf', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d56aa2-9575-4e96-a8f5-38548c48624f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:39 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Volume volume-79fc18e2-27fe-47e8-a987-5784091ceaaf (79fc18e2-27fe-47e8-a987-5784091ceaaf): created successfully Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d56aa2-9575-4e96-a8f5-38548c48624f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:39 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 Feb 27 02:07:39 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Flow 'volume_create_manager' (14c0325d-1aac-49af-b06a-db244158e5c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:39 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-ced9cdd1-19be-4195-96be-e26631d20046 tempest-VolumesActionsTest-1749971523 None] Created volume successfully. Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d91a672a-21de-4ba5-9ea5-2fa053abae66 tempest-VolumesActionsTest-1749971523 None] Acquiring lock "cinder-79fc18e2-27fe-47e8-a987-5784091ceaaf" by "attach_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d91a672a-21de-4ba5-9ea5-2fa053abae66 tempest-VolumesActionsTest-1749971523 None] Lock "cinder-79fc18e2-27fe-47e8-a987-5784091ceaaf" acquired by "attach_volume" :: waited 0.018s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:39 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747" returned: 0 in 0.730s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c63c2c8-4e07-427e-b18c-2637e535bad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0859ad-3a07-40f0-a144-089f4129acfd]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:39 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-d91a672a-21de-4ba5-9ea5-2fa053abae66 tempest-VolumesActionsTest-1749971523 None] Attaching volume 79fc18e2-27fe-47e8-a987-5784091ceaaf to instance 06065250-b641-40dd-9798-4ca9d577b93c at mountpoint /dev/vdb on host None. Feb 27 02:07:39 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-d91a672a-21de-4ba5-9ea5-2fa053abae66 tempest-VolumesActionsTest-1749971523 None] Attach volume completed successfully. Feb 27 02:07:39 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d91a672a-21de-4ba5-9ea5-2fa053abae66 tempest-VolumesActionsTest-1749971523 None] Lock "cinder-79fc18e2-27fe-47e8-a987-5784091ceaaf" released by "attach_volume" :: held 0.106s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:39 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1 Feb 27 02:07:39 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:41 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1" returned: 0 in 1.262s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:41 devstack sudo[88474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 Feb 27 02:07:41 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:41 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-905861d8-d1f8-42b3-9024-f86bca31db5b tempest-VolumesActionsTest-1522634436 None] Terminate volume connection completed successfully. Feb 27 02:07:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-905861d8-d1f8-42b3-9024-f86bca31db5b tempest-VolumesActionsTest-1522634436 None] Acquiring lock "cinder-79fc18e2-27fe-47e8-a987-5784091ceaaf-detach_volume" by "detach_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-905861d8-d1f8-42b3-9024-f86bca31db5b tempest-VolumesActionsTest-1522634436 None] Lock "cinder-79fc18e2-27fe-47e8-a987-5784091ceaaf-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:42 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=87,cinder:INSERT=33,cinder:UPDATE=102,cinder:DELETE=12 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:07:42 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=94,cinder:INSERT=22,cinder:UPDATE=111,cinder:DELETE=6 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:07:42 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-905861d8-d1f8-42b3-9024-f86bca31db5b tempest-VolumesActionsTest-1522634436 None] Detaching volume 79fc18e2-27fe-47e8-a987-5784091ceaaf from instance 06065250-b641-40dd-9798-4ca9d577b93c. Feb 27 02:07:42 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-905861d8-d1f8-42b3-9024-f86bca31db5b tempest-VolumesActionsTest-1522634436 None] Detach volume completed successfully. Feb 27 02:07:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-905861d8-d1f8-42b3-9024-f86bca31db5b tempest-VolumesActionsTest-1522634436 None] Lock "cinder-79fc18e2-27fe-47e8-a987-5784091ceaaf-detach_volume" released by "detach_volume" :: held 0.200s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:42 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747" returned: 0 in 1.231s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:42 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747 Feb 27 02:07:42 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7626926c-cf4d-4fa0-bda8-4471145f7d07 tempest-VolumesActionsTest-1749971523 None] Acquiring lock "cinder-79fc18e2-27fe-47e8-a987-5784091ceaaf-detach_volume" by "detach_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7626926c-cf4d-4fa0-bda8-4471145f7d07 tempest-VolumesActionsTest-1749971523 None] Lock "cinder-79fc18e2-27fe-47e8-a987-5784091ceaaf-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:42 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-7626926c-cf4d-4fa0-bda8-4471145f7d07 tempest-VolumesActionsTest-1749971523 None] Volume detach called, but volume not attached. Feb 27 02:07:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7626926c-cf4d-4fa0-bda8-4471145f7d07 tempest-VolumesActionsTest-1749971523 None] Lock "cinder-79fc18e2-27fe-47e8-a987-5784091ceaaf-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:43 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1.c9b0f0ac-db98-481b-83d6-4f798d8a7747" returned: 0 in 0.759s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:43 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-quobyte-c9b0f0ac-db98-481b-83d6-4f798d8a7747" released by "_delete_snapshot" :: held 4.103s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:43 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-quobyte-9c63c2c8-4e07-427e-b18c-2637e535bad1" released by "delete_snapshot" :: held 4.128s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:43 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] Created reservations ['9f2338cd-ff13-433c-ba29-3a18017a2d46', '3f4f8c01-027b-4d50-a386-3c77b4401f49', '84acb4fe-61e4-47c1-aa9c-7e8c98b0c095', '907e7239-cd87-4da7-b0cb-9cddaa78656e'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:43 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] Delete snapshot completed successfully. Feb 27 02:07:43 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1a2c0804-0424-4b44-af36-9cc8d7e0c714 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-c9b0f0ac-db98-481b-83d6-4f798d8a7747-delete_snapshot" released by "delete_snapshot" :: held 4.310s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:43 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] Acquiring lock "cinder-79fc18e2-27fe-47e8-a987-5784091ceaaf-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:43 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] Lock "cinder-79fc18e2-27fe-47e8-a987-5784091ceaaf-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:43 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] Acquiring lock "cinder-quobyte-79fc18e2-27fe-47e8-a987-5784091ceaaf" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:43 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] Lock "cinder-quobyte-79fc18e2-27fe-47e8-a987-5784091ceaaf" acquired by "delete_volume" :: waited 0.029s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:43 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a57165b-aa8d-4c5f-af3e-d2cfee90f84b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fc18e2-27fe-47e8-a987-5784091ceaaf {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:43 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fc18e2-27fe-47e8-a987-5784091ceaaf Feb 27 02:07:43 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] Acquiring lock "cinder-9c63c2c8-4e07-427e-b18c-2637e535bad1-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-9c63c2c8-4e07-427e-b18c-2637e535bad1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] Acquiring lock "cinder-quobyte-9c63c2c8-4e07-427e-b18c-2637e535bad1" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-quobyte-9c63c2c8-4e07-427e-b18c-2637e535bad1" acquired by "delete_volume" :: waited 0.025s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b732ea9-01c0-439c-9502-785958b8e8c0]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:44 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1 Feb 27 02:07:44 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:44 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fc18e2-27fe-47e8-a987-5784091ceaaf" returned: 0 in 1.134s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fc18e2-27fe-47e8-a987-5784091ceaaf {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:44 devstack sudo[88491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fc18e2-27fe-47e8-a987-5784091ceaaf Feb 27 02:07:44 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Flow 'volume_create_manager' (3bf80429-1345-4869-9b78-4fd53b32625d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bafe3b2-cb7a-4992-9c0a-157feffe175f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bafe3b2-cb7a-4992-9c0a-157feffe175f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-105474207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d44028a1-065c-4814-b60c-35e81abadd11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11122a0b76f64705b18d8ceacaac61e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:45Z,use_quota=True,user_id='88277784b2f141df8f15805202025325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9cbda6f-35a8-4461-af1b-2469a5746838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9cbda6f-35a8-4461-af1b-2469a5746838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e616af32-6e58-41d5-8396-c7f016ea2253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e616af32-6e58-41d5-8396-c7f016ea2253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd44028a1-065c-4814-b60c-35e81abadd11', 'volume_name': 'volume-d44028a1-065c-4814-b60c-35e81abadd11', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fa4e23-30b6-48bf-ae39-911dff2524b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fa4e23-30b6-48bf-ae39-911dff2524b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9521c6-0b49-463f-b935-0896a206bfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:44 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Volume d44028a1-065c-4814-b60c-35e81abadd11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d44028a1-065c-4814-b60c-35e81abadd11', 'volume_size': 1} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-105474207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d44028a1-065c-4814-b60c-35e81abadd11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11122a0b76f64705b18d8ceacaac61e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:45Z,use_quota=True,user_id='88277784b2f141df8f15805202025325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Creating volume d44028a1-065c-4814-b60c-35e81abadd11 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:44 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:07:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d44028a1-065c-4814-b60c-35e81abadd11 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:44 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d44028a1-065c-4814-b60c-35e81abadd11 1073741824 Feb 27 02:07:44 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:45 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-79fc18e2-27fe-47e8-a987-5784091ceaaf" returned: 0 in 0.978s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] Lock "cinder-quobyte-79fc18e2-27fe-47e8-a987-5784091ceaaf" released by "delete_volume" :: held 2.168s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:45 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1" returned: 0 in 1.277s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:45 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] Created reservations ['3cf87c3d-bc09-4127-b372-15aadd06764c', '7aa04bc9-7a7a-499b-af68-0d97b9eb7079', '12d18c72-fe47-4d86-b6c3-8d0e94afd443', 'cf3a303f-ecba-406b-a3df-1d45f1324f23'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:45 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1 Feb 27 02:07:45 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:46 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d44028a1-065c-4814-b60c-35e81abadd11 1073741824" returned: 0 in 1.070s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d44028a1-065c-4814-b60c-35e81abadd11 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:46 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:07:46 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:46 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d44028a1-065c-4814-b60c-35e81abadd11 Feb 27 02:07:46 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:46 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c63c2c8-4e07-427e-b18c-2637e535bad1" returned: 0 in 0.721s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-quobyte-9c63c2c8-4e07-427e-b18c-2637e535bad1" released by "delete_volume" :: held 2.064s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:46 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:46 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] Created reservations ['35f7177b-0d88-4886-8263-b8d12007d55b', '92f26965-da71-45a0-a6bc-60bf39b7723d', 'c608f83c-2f8b-4fa8-9c12-a3ed71927fd4', '7f7a69d4-969c-4d8e-8eef-4bd1479cc7ea'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d44028a1-065c-4814-b60c-35e81abadd11" returned: 0 in 0.599s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.620s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:46 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] Deleted volume successfully. Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9521c6-0b49-463f-b935-0896a206bfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d44028a1-065c-4814-b60c-35e81abadd11', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ceff7f-0ec8-4fb3-b17d-1fc6a7c9b698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:46 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Volume volume-d44028a1-065c-4814-b60c-35e81abadd11 (d44028a1-065c-4814-b60c-35e81abadd11): created successfully Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ceff7f-0ec8-4fb3-b17d-1fc6a7c9b698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Flow 'volume_create_manager' (3bf80429-1345-4869-9b78-4fd53b32625d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:46 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b03aba48-025e-45ed-a0c7-b728324aec4a tempest-VolumeQuotasNegativeTestJSON-187636881 None] Created volume successfully. Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ca68b041-0b0f-411f-8ad7-76484e72e6a9 tempest-VolumesActionsTest-1749971523 None] Lock "cinder-79fc18e2-27fe-47e8-a987-5784091ceaaf-delete_volume" released by "delete_volume" :: held 3.251s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:46 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:07:46 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:47 devstack cinder-volume[83231]: DEBUG oslo_service.periodic_task [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83231) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:07:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:47 devstack sudo[88536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:07:47 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:47 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.828s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:47 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:47 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] Deleted volume successfully. Feb 27 02:07:47 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9d7ecae4-0210-44b0-9b82-35cdf8e82603 tempest-VolumesSnapshotListTestJSON-472945567 None] Lock "cinder-9c63c2c8-4e07-427e-b18c-2637e535bad1-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:47 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.698s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:47 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] Acquiring lock "cinder-d44028a1-065c-4814-b60c-35e81abadd11-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] Lock "cinder-d44028a1-065c-4814-b60c-35e81abadd11-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] Acquiring lock "cinder-quobyte-d44028a1-065c-4814-b60c-35e81abadd11" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] Lock "cinder-quobyte-d44028a1-065c-4814-b60c-35e81abadd11" acquired by "delete_volume" :: waited 0.016s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:48 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b3ab93-0abd-47d2-a1f6-57b95cd1f49b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d44028a1-065c-4814-b60c-35e81abadd11 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:48 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d44028a1-065c-4814-b60c-35e81abadd11 Feb 27 02:07:48 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:49 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d44028a1-065c-4814-b60c-35e81abadd11" returned: 0 in 0.788s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d44028a1-065c-4814-b60c-35e81abadd11 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:49 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d44028a1-065c-4814-b60c-35e81abadd11 Feb 27 02:07:49 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:50 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d44028a1-065c-4814-b60c-35e81abadd11" returned: 0 in 0.622s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] Lock "cinder-quobyte-d44028a1-065c-4814-b60c-35e81abadd11" released by "delete_volume" :: held 1.456s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] Created reservations ['58ace73b-7677-48f9-9158-1829703fd2fd', '05e2bd34-0957-4b78-9b60-0b265e5284a5', '949eba66-770b-42fd-8727-4b6fec16e09a', 'f45c0dba-d774-4153-b58c-032bc520afd3'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:50 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:07:50 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Flow 'volume_create_manager' (d17877e4-78b0-4729-8258-8e4e464e6132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1506ffc6-3cec-4e99-b0b8-902b4aa07a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1506ffc6-3cec-4e99-b0b8-902b4aa07a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1806317474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4d942f-30b2-4fbb-b3fc-f371c708a8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4131fa17189842eabc737d85a5696ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:51Z,use_quota=True,user_id='6876a1b756844a42b18987262b5f78e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd858f4-6a7e-4d18-a88b-c52ce530e6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd858f4-6a7e-4d18-a88b-c52ce530e6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9677b149-98de-4316-9400-c407d3521422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9677b149-98de-4316-9400-c407d3521422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a4d942f-30b2-4fbb-b3fc-f371c708a8d3', 'volume_name': 'volume-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b938a35-b497-4536-9eb5-330ee6d72db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b938a35-b497-4536-9eb5-330ee6d72db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b20367e-b597-4bf2-8b67-dcdb9df1893e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Volume 2a4d942f-30b2-4fbb-b3fc-f371c708a8d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3', 'volume_size': 1} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1806317474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4d942f-30b2-4fbb-b3fc-f371c708a8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4131fa17189842eabc737d85a5696ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:51Z,use_quota=True,user_id='6876a1b756844a42b18987262b5f78e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Creating volume 2a4d942f-30b2-4fbb-b3fc-f371c708a8d3 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:50 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:50 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3 1073741824 Feb 27 02:07:50 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:50 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.551s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:50 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] Deleted volume successfully. Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-22ea45ec-b7d4-4f30-a87e-a69e982157f2 tempest-VolumeQuotasNegativeTestJSON-187636881 None] Lock "cinder-d44028a1-065c-4814-b60c-35e81abadd11-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Flow 'volume_create_manager' (ba2566fa-36ed-413a-8d0e-d631ce0aa808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaadde76-69a9-4432-b47a-ec3101b1a4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaadde76-69a9-4432-b47a-ec3101b1a4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1718440887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e2ba39-3670-4916-841f-45bfef231e06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4131fa17189842eabc737d85a5696ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:51Z,use_quota=True,user_id='6876a1b756844a42b18987262b5f78e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982db31d-1e8b-47b4-be73-a250dbaf049d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982db31d-1e8b-47b4-be73-a250dbaf049d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b03f6009-8b32-4aec-a46f-37ce400a6c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b03f6009-8b32-4aec-a46f-37ce400a6c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e2ba39-3670-4916-841f-45bfef231e06', 'volume_name': 'volume-49e2ba39-3670-4916-841f-45bfef231e06', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04481ef0-b830-4faa-b239-bbf44b134408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04481ef0-b830-4faa-b239-bbf44b134408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40944331-28ef-4872-b3c9-7586e2b48a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Volume 49e2ba39-3670-4916-841f-45bfef231e06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e2ba39-3670-4916-841f-45bfef231e06', 'volume_size': 1} Feb 27 02:07:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Flow 'volume_create_manager' (0e8c620c-ebd5-49ae-97a6-785acbe2154f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0263a774-b6a1-4fa0-b5ae-2426ee67e9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0263a774-b6a1-4fa0-b5ae-2426ee67e9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-984660318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a576c1-8170-449d-9464-e8f7a4975fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4131fa17189842eabc737d85a5696ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:51Z,use_quota=True,user_id='6876a1b756844a42b18987262b5f78e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9986ee45-3016-449f-8294-c3b9bede6406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9986ee45-3016-449f-8294-c3b9bede6406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e65bc9-18f9-4274-9771-0a8787828c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e65bc9-18f9-4274-9771-0a8787828c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36a576c1-8170-449d-9464-e8f7a4975fea', 'volume_name': 'volume-36a576c1-8170-449d-9464-e8f7a4975fea', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c68be10-8ec9-41ba-8217-8d9c40ad13ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c68be10-8ec9-41ba-8217-8d9c40ad13ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fcd719-c842-44f3-923e-df706951d350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Volume 36a576c1-8170-449d-9464-e8f7a4975fea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36a576c1-8170-449d-9464-e8f7a4975fea', 'volume_size': 1} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:51 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3 1073741824" returned: 0 in 0.832s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:51 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3 Feb 27 02:07:51 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Flow 'volume_create_manager' (3305047b-8bff-496d-8f41-d3b223cbd76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10fe9925-07e4-4f51-8fa6-da8a3a356290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10fe9925-07e4-4f51-8fa6-da8a3a356290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-527647573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf73cc4-807f-44ce-a682-cadb53d7821a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4131fa17189842eabc737d85a5696ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:51Z,use_quota=True,user_id='6876a1b756844a42b18987262b5f78e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ee4f24-13fa-4e5e-9228-78e2236c02f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ee4f24-13fa-4e5e-9228-78e2236c02f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6b4e5f-f981-45b0-ab12-e5a642da8608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6b4e5f-f981-45b0-ab12-e5a642da8608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf73cc4-807f-44ce-a682-cadb53d7821a', 'volume_name': 'volume-abf73cc4-807f-44ce-a682-cadb53d7821a', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd48d4f-dbce-46bc-bc00-c8123b23944e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd48d4f-dbce-46bc-bc00-c8123b23944e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954aeb09-3ca4-463d-8ef2-59e7009c97d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Volume abf73cc4-807f-44ce-a682-cadb53d7821a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf73cc4-807f-44ce-a682-cadb53d7821a', 'volume_size': 1} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Flow 'volume_create_manager' (2707a265-7a30-41d1-aaaa-dc2d56799bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ceab55-7418-4dd9-88d0-b41a2375b229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ceab55-7418-4dd9-88d0-b41a2375b229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-653426609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75db43c-f57a-4b89-807f-89e4a887ce21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4131fa17189842eabc737d85a5696ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:52Z,use_quota=True,user_id='6876a1b756844a42b18987262b5f78e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f47e17e-9ac5-4eec-b836-d8acacaf50ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f47e17e-9ac5-4eec-b836-d8acacaf50ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82541fb-53a0-482c-9c58-9f0d32aa74fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82541fb-53a0-482c-9c58-9f0d32aa74fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd75db43c-f57a-4b89-807f-89e4a887ce21', 'volume_name': 'volume-d75db43c-f57a-4b89-807f-89e4a887ce21', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3baee3a-233d-4cfa-a857-e7c1823d5629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3baee3a-233d-4cfa-a857-e7c1823d5629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d97a9b-bbf0-4582-a0db-232441ad4488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Volume d75db43c-f57a-4b89-807f-89e4a887ce21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d75db43c-f57a-4b89-807f-89e4a887ce21', 'volume_size': 1} Feb 27 02:07:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:52 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3" returned: 0 in 0.756s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.402s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1718440887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e2ba39-3670-4916-841f-45bfef231e06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4131fa17189842eabc737d85a5696ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:51Z,use_quota=True,user_id='6876a1b756844a42b18987262b5f78e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Creating volume 49e2ba39-3670-4916-841f-45bfef231e06 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:52 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:07:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-49e2ba39-3670-4916-841f-45bfef231e06 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b20367e-b597-4bf2-8b67-dcdb9df1893e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d8f6b6-28c8-464c-8fd9-d7d7b01627b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:52 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Volume volume-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3 (2a4d942f-30b2-4fbb-b3fc-f371c708a8d3): created successfully Feb 27 02:07:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d8f6b6-28c8-464c-8fd9-d7d7b01627b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Flow 'volume_create_manager' (d17877e4-78b0-4729-8258-8e4e464e6132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:52 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-49e2ba39-3670-4916-841f-45bfef231e06 1073741824 Feb 27 02:07:52 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:52 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-f8f58a69-7134-495e-b678-957e6ab530de tempest-CreateVolumesFromImageTest-481366762 None] Created volume successfully. Feb 27 02:07:53 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-49e2ba39-3670-4916-841f-45bfef231e06 1073741824" returned: 0 in 0.787s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-49e2ba39-3670-4916-841f-45bfef231e06 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:53 devstack sudo[88587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-49e2ba39-3670-4916-841f-45bfef231e06 Feb 27 02:07:53 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:53 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-49e2ba39-3670-4916-841f-45bfef231e06" returned: 0 in 0.577s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.328s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-984660318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a576c1-8170-449d-9464-e8f7a4975fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4131fa17189842eabc737d85a5696ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:51Z,use_quota=True,user_id='6876a1b756844a42b18987262b5f78e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Creating volume 36a576c1-8170-449d-9464-e8f7a4975fea {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:53 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:07:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-36a576c1-8170-449d-9464-e8f7a4975fea 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40944331-28ef-4872-b3c9-7586e2b48a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e2ba39-3670-4916-841f-45bfef231e06', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cbdade5-e991-430d-9b2a-9c846eac951d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:53 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-36a576c1-8170-449d-9464-e8f7a4975fea 1073741824 Feb 27 02:07:53 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:53 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Volume volume-49e2ba39-3670-4916-841f-45bfef231e06 (49e2ba39-3670-4916-841f-45bfef231e06): created successfully Feb 27 02:07:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cbdade5-e991-430d-9b2a-9c846eac951d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Flow 'volume_create_manager' (ba2566fa-36ed-413a-8d0e-d631ce0aa808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:53 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-22e8bd23-affe-4ae7-94fc-f72abb7d582c tempest-CreateVolumesFromImageTest-481366762 None] Created volume successfully. Feb 27 02:07:54 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Flow 'volume_create_manager' (200bfe35-8b9d-445c-950b-3e1eca909bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6654bf-8781-4023-abe6-671bbe9dabc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6654bf-8781-4023-abe6-671bbe9dabc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1453210299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd5e8eaa-a5da-493d-99ee-43ed1d6133ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4b4a818374673a9e4f1d4de60bc28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:54Z,use_quota=True,user_id='cb656269e31b4ee1be63f048eb13cc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68e7a20-98d6-4c70-bf1f-a6d005a12378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68e7a20-98d6-4c70-bf1f-a6d005a12378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a435ff0-5b76-4135-a93f-c0c7be624db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a435ff0-5b76-4135-a93f-c0c7be624db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd5e8eaa-a5da-493d-99ee-43ed1d6133ab', 'volume_name': 'volume-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c56f9e-d76b-427b-a6ac-e8a63d08522d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c56f9e-d76b-427b-a6ac-e8a63d08522d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1a8f33-b31c-4715-8c8c-c7ec2682df8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:54 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Volume fd5e8eaa-a5da-493d-99ee-43ed1d6133ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab', 'volume_size': 1} Feb 27 02:07:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:54 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-36a576c1-8170-449d-9464-e8f7a4975fea 1073741824" returned: 0 in 0.722s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-36a576c1-8170-449d-9464-e8f7a4975fea {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:54 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-36a576c1-8170-449d-9464-e8f7a4975fea Feb 27 02:07:54 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:55 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-36a576c1-8170-449d-9464-e8f7a4975fea" returned: 0 in 0.647s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.402s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-527647573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf73cc4-807f-44ce-a682-cadb53d7821a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4131fa17189842eabc737d85a5696ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:51Z,use_quota=True,user_id='6876a1b756844a42b18987262b5f78e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Creating volume abf73cc4-807f-44ce-a682-cadb53d7821a {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:55 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:07:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-abf73cc4-807f-44ce-a682-cadb53d7821a 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fcd719-c842-44f3-923e-df706951d350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36a576c1-8170-449d-9464-e8f7a4975fea', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd5e972-4f11-464a-9d83-0b6fd22c5fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:55 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Volume volume-36a576c1-8170-449d-9464-e8f7a4975fea (36a576c1-8170-449d-9464-e8f7a4975fea): created successfully Feb 27 02:07:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd5e972-4f11-464a-9d83-0b6fd22c5fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:55 devstack sudo[88600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-abf73cc4-807f-44ce-a682-cadb53d7821a 1073741824 Feb 27 02:07:55 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Flow 'volume_create_manager' (0e8c620c-ebd5-49ae-97a6-785acbe2154f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:55 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-f6383c1e-1c18-4111-8775-5affefea7f4f tempest-CreateVolumesFromImageTest-481366762 None] Created volume successfully. Feb 27 02:07:56 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-abf73cc4-807f-44ce-a682-cadb53d7821a 1073741824" returned: 0 in 1.007s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-abf73cc4-807f-44ce-a682-cadb53d7821a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:56 devstack sudo[88605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-abf73cc4-807f-44ce-a682-cadb53d7821a Feb 27 02:07:56 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:56 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-abf73cc4-807f-44ce-a682-cadb53d7821a" returned: 0 in 0.610s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:56 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.876s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:56 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-653426609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75db43c-f57a-4b89-807f-89e4a887ce21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4131fa17189842eabc737d85a5696ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:52Z,use_quota=True,user_id='6876a1b756844a42b18987262b5f78e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:56 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Creating volume d75db43c-f57a-4b89-807f-89e4a887ce21 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:56 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:56 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:56 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:56 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:07:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d75db43c-f57a-4b89-807f-89e4a887ce21 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954aeb09-3ca4-463d-8ef2-59e7009c97d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf73cc4-807f-44ce-a682-cadb53d7821a', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51740c9d-4139-4d78-8099-06d8f5a9e4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:56 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d75db43c-f57a-4b89-807f-89e4a887ce21 1073741824 Feb 27 02:07:56 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:56 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Volume volume-abf73cc4-807f-44ce-a682-cadb53d7821a (abf73cc4-807f-44ce-a682-cadb53d7821a): created successfully Feb 27 02:07:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51740c9d-4139-4d78-8099-06d8f5a9e4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:56 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Flow 'volume_create_manager' (3305047b-8bff-496d-8f41-d3b223cbd76b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:56 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-71623935-80d7-4ab8-bfe6-e5f52e3c7680 tempest-CreateVolumesFromImageTest-481366762 None] Created volume successfully. Feb 27 02:07:57 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] Acquiring lock "cinder-b79603b0-e1db-4969-80d6-18a8bc8a8998-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:57 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] Lock "cinder-b79603b0-e1db-4969-80d6-18a8bc8a8998-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:57 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] Acquiring lock "cinder-quobyte-b79603b0-e1db-4969-80d6-18a8bc8a8998" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:57 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] Lock "cinder-quobyte-b79603b0-e1db-4969-80d6-18a8bc8a8998" acquired by "delete_volume" :: waited 0.032s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:57 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89d38e8-b172-411a-84dc-e7a7112bc11b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b79603b0-e1db-4969-80d6-18a8bc8a8998 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:57 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d75db43c-f57a-4b89-807f-89e4a887ce21 1073741824" returned: 0 in 0.826s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d75db43c-f57a-4b89-807f-89e4a887ce21 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:57 devstack sudo[88615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d75db43c-f57a-4b89-807f-89e4a887ce21 Feb 27 02:07:57 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:57 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b79603b0-e1db-4969-80d6-18a8bc8a8998 Feb 27 02:07:57 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:58 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b79603b0-e1db-4969-80d6-18a8bc8a8998" returned: 0 in 0.680s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b79603b0-e1db-4969-80d6-18a8bc8a8998 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:58 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d75db43c-f57a-4b89-807f-89e4a887ce21" returned: 0 in 0.655s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:58 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b79603b0-e1db-4969-80d6-18a8bc8a8998 Feb 27 02:07:58 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.047s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1453210299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd5e8eaa-a5da-493d-99ee-43ed1d6133ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4b4a818374673a9e4f1d4de60bc28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:54Z,use_quota=True,user_id='cb656269e31b4ee1be63f048eb13cc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Creating volume fd5e8eaa-a5da-493d-99ee-43ed1d6133ab {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:58 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d97a9b-bbf0-4582-a0db-232441ad4488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d75db43c-f57a-4b89-807f-89e4a887ce21', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:58 devstack sudo[88626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab 1073741824 Feb 27 02:07:58 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df26c2b0-9cdf-4080-b585-9d523b8a28c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:58 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Volume volume-d75db43c-f57a-4b89-807f-89e4a887ce21 (d75db43c-f57a-4b89-807f-89e4a887ce21): created successfully Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df26c2b0-9cdf-4080-b585-9d523b8a28c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Flow 'volume_create_manager' (2707a265-7a30-41d1-aaaa-dc2d56799bdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:58 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-2e43e35b-b0fb-47df-a1f2-aac186b2f65b tempest-CreateVolumesFromImageTest-481366762 None] Created volume successfully. Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "cinder-d75db43c-f57a-4b89-807f-89e4a887ce21-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-d75db43c-f57a-4b89-807f-89e4a887ce21-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "cinder-quobyte-d75db43c-f57a-4b89-807f-89e4a887ce21" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:58 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b79603b0-e1db-4969-80d6-18a8bc8a8998" returned: 0 in 0.607s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] Lock "cinder-quobyte-b79603b0-e1db-4969-80d6-18a8bc8a8998" released by "delete_volume" :: held 1.325s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-quobyte-d75db43c-f57a-4b89-807f-89e4a887ce21" acquired by "delete_volume" :: waited 0.034s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7d055e-5992-4f7b-853e-69e0fa7657a3]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d75db43c-f57a-4b89-807f-89e4a887ce21 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:58 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] Created reservations ['f1160ab4-3069-4e25-834a-03c0e53c8713', 'b78c7139-4b95-42ff-9bae-6de6418ce182', '1226d18b-5385-468f-8a2d-aaaefc139ae5', '699bf188-11d4-4850-8ccb-cfb0af087776'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:59 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab 1073741824" returned: 0 in 0.711s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:59 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d75db43c-f57a-4b89-807f-89e4a887ce21 Feb 27 02:07:59 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:07:59 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:59 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:59 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab Feb 27 02:07:59 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:59 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.597s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:59 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] Deleted volume successfully. Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ef2cad4a-92db-4152-9b34-7c9bd3f6d519 tempest-VolumesNegativeTest-49663951 None] Lock "cinder-b79603b0-e1db-4969-80d6-18a8bc8a8998-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:59 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d75db43c-f57a-4b89-807f-89e4a887ce21" returned: 0 in 0.769s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d75db43c-f57a-4b89-807f-89e4a887ce21 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:59 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d75db43c-f57a-4b89-807f-89e4a887ce21 Feb 27 02:07:59 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:59 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab" returned: 0 in 0.672s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1a8f33-b31c-4715-8c8c-c7ec2682df8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a920379a-1c1c-490f-9537-4fdad2cf0bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:59 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Volume volume-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab (fd5e8eaa-a5da-493d-99ee-43ed1d6133ab): created successfully Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a920379a-1c1c-490f-9537-4fdad2cf0bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Flow 'volume_create_manager' (200bfe35-8b9d-445c-950b-3e1eca909bf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:59 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-f0f5cded-e55f-4f72-8317-b2404290ee66 tempest-VolumesActionsTest-1749971523 None] Created volume successfully. Feb 27 02:08:00 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d75db43c-f57a-4b89-807f-89e4a887ce21" returned: 0 in 0.514s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:00 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-quobyte-d75db43c-f57a-4b89-807f-89e4a887ce21" released by "delete_volume" :: held 1.318s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:00 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] Created reservations ['caa31bda-7912-46f5-8f7f-ada22d4422c3', '9a6837a9-5a81-457b-b46f-c7c48225cffd', '09266df9-bf79-4c92-a28f-f110bda61ec7', '831a77ae-27e6-4704-85dd-7ad2f4c368d9'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:00 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:08:00 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:00 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] Acquiring lock "cinder-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:00 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] Lock "cinder-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:00 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] Acquiring lock "cinder-quobyte-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:00 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] Lock "cinder-quobyte-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab" acquired by "delete_volume" :: waited 0.038s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:00 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb18358-c1ee-4d2a-ae93-d285dd64751c]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.566s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:00 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:00 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:00 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] Deleted volume successfully. Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-52691a22-6d65-43f3-b565-e2d3c9444e36 tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-d75db43c-f57a-4b89-807f-89e4a887ce21-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "cinder-abf73cc4-807f-44ce-a682-cadb53d7821a-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:01 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab Feb 27 02:08:01 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Flow 'volume_create_manager' (b1db96fa-c649-4bf0-b78c-1b20c9e6ff7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab764907-0193-4243-9703-8a8dffd506d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-abf73cc4-807f-44ce-a682-cadb53d7821a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab764907-0193-4243-9703-8a8dffd506d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1332572772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9967d4-e807-46e7-8f3d-15907fd006a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6843c222ed704d6da29d918f329d3db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:01Z,use_quota=True,user_id='48dd84232be345b89d0dcf08bb8fbb46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8294fba-51cf-44fc-a86c-122b07937cd0),volume_type_id=d8294fba-51cf-44fc-a86c-122b07937cd0)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa7c61b-fffe-4859-9deb-2fb9043927d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa7c61b-fffe-4859-9deb-2fb9043927d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af49df37-c0b9-45bc-82f1-1ae7dd8d30dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af49df37-c0b9-45bc-82f1-1ae7dd8d30dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f9967d4-e807-46e7-8f3d-15907fd006a6', 'volume_name': 'volume-9f9967d4-e807-46e7-8f3d-15907fd006a6', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98cd8ce-339b-4b5c-9cef-40aed8c2c0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98cd8ce-339b-4b5c-9cef-40aed8c2c0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da1f68a-3a54-4eb0-9500-dde7dec107d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:01 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Volume 9f9967d4-e807-46e7-8f3d-15907fd006a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f9967d4-e807-46e7-8f3d-15907fd006a6', 'volume_size': 1} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1332572772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9967d4-e807-46e7-8f3d-15907fd006a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6843c222ed704d6da29d918f329d3db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:01Z,use_quota=True,user_id='48dd84232be345b89d0dcf08bb8fbb46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8294fba-51cf-44fc-a86c-122b07937cd0),volume_type_id=d8294fba-51cf-44fc-a86c-122b07937cd0)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Creating volume 9f9967d4-e807-46e7-8f3d-15907fd006a6 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:01 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9f9967d4-e807-46e7-8f3d-15907fd006a6 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:01 devstack sudo[88654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9f9967d4-e807-46e7-8f3d-15907fd006a6 1073741824 Feb 27 02:08:01 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "cinder-quobyte-abf73cc4-807f-44ce-a682-cadb53d7821a" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-quobyte-abf73cc4-807f-44ce-a682-cadb53d7821a" acquired by "delete_volume" :: waited 0.012s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57b9897-5ca3-448e-bd01-00d885da1c82]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-abf73cc4-807f-44ce-a682-cadb53d7821a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:01 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-abf73cc4-807f-44ce-a682-cadb53d7821a Feb 27 02:08:01 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:01 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab" returned: 0 in 0.610s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:01 devstack sudo[88661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab Feb 27 02:08:01 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:01 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-abf73cc4-807f-44ce-a682-cadb53d7821a" returned: 0 in 0.659s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-abf73cc4-807f-44ce-a682-cadb53d7821a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:01 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9f9967d4-e807-46e7-8f3d-15907fd006a6 1073741824" returned: 0 in 0.740s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:01 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-abf73cc4-807f-44ce-a682-cadb53d7821a Feb 27 02:08:01 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9f9967d4-e807-46e7-8f3d-15907fd006a6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:02 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9f9967d4-e807-46e7-8f3d-15907fd006a6 Feb 27 02:08:02 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:02 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab" returned: 0 in 0.538s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] Lock "cinder-quobyte-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab" released by "delete_volume" :: held 1.192s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] Created reservations ['32eb488e-40ba-48e5-bf1d-8731286b4c0c', '0d834f97-7da1-4e8d-b4b5-0b1dd72f7f2f', '58c62d26-bfff-438f-a7aa-3cc884001307', 'f88726b2-1655-4bd6-8008-4cce660d5714'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:02 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:08:02 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:02 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9f9967d4-e807-46e7-8f3d-15907fd006a6" returned: 0 in 0.596s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da1f68a-3a54-4eb0-9500-dde7dec107d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f9967d4-e807-46e7-8f3d-15907fd006a6', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83496ae-eb8d-4233-b6f5-66a593475b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:02 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Volume volume-9f9967d4-e807-46e7-8f3d-15907fd006a6 (9f9967d4-e807-46e7-8f3d-15907fd006a6): created successfully Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83496ae-eb8d-4233-b6f5-66a593475b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Flow 'volume_create_manager' (b1db96fa-c649-4bf0-b78c-1b20c9e6ff7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:02 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-830d1b6c-bb24-404d-b9cc-b233addd5b78 tempest-VolumeTypesAccessTest-1285840269 None] Created volume successfully. Feb 27 02:08:02 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-abf73cc4-807f-44ce-a682-cadb53d7821a" returned: 0 in 0.824s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-quobyte-abf73cc4-807f-44ce-a682-cadb53d7821a" released by "delete_volume" :: held 1.512s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] Created reservations ['d8013258-af1e-4ec8-9470-e902aac1bbd3', '15ccdbe3-555b-4bba-bac5-b3e418d53483', '4a7a61d3-e820-49a2-9e1c-b9ec2f67e7bc', '810284af-f0f5-4e69-8ebd-fc6bb0904342'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:02 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.561s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:02 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] Deleted volume successfully. Feb 27 02:08:02 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:08:02 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:02 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-5f4cd5d9-46b1-4dd5-b7e6-85736573be71 tempest-VolumesActionsTest-1522634436 None] Lock "cinder-fd5e8eaa-a5da-493d-99ee-43ed1d6133ab-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] Acquiring lock "cinder-9f9967d4-e807-46e7-8f3d-15907fd006a6-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:03 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] Lock "cinder-9f9967d4-e807-46e7-8f3d-15907fd006a6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.512s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:03 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] Deleted volume successfully. Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-88142611-03a7-4d48-a882-9002984a3dd0 tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-abf73cc4-807f-44ce-a682-cadb53d7821a-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] Acquiring lock "cinder-quobyte-9f9967d4-e807-46e7-8f3d-15907fd006a6" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "cinder-36a576c1-8170-449d-9464-e8f7a4975fea-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] Lock "cinder-quobyte-9f9967d4-e807-46e7-8f3d-15907fd006a6" acquired by "delete_volume" :: waited 0.032s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-36a576c1-8170-449d-9464-e8f7a4975fea-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Flow 'volume_create_manager' (5b6bf6d2-29fd-456a-9106-0d05a4c0b946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896ca442-ee53-42e4-b18d-c19ff65fdf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9956da9c-88dd-4b79-a1de-2d29a9b06e91]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896ca442-ee53-42e4-b18d-c19ff65fdf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-625551841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6422b45-9e98-4212-a0e4-4fa18767d2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4b4a818374673a9e4f1d4de60bc28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:03Z,use_quota=True,user_id='cb656269e31b4ee1be63f048eb13cc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a487123e-fd10-420c-a17a-4e4cb98982c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a487123e-fd10-420c-a17a-4e4cb98982c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3fcbc4f-63b0-492e-b571-713bf050b95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3fcbc4f-63b0-492e-b571-713bf050b95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6422b45-9e98-4212-a0e4-4fa18767d2f6', 'volume_name': 'volume-b6422b45-9e98-4212-a0e4-4fa18767d2f6', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4e53b2-28f8-4198-b20f-8ddf04737df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4e53b2-28f8-4198-b20f-8ddf04737df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d811cc20-2392-4661-b6ab-cab7cd314689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Volume b6422b45-9e98-4212-a0e4-4fa18767d2f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6422b45-9e98-4212-a0e4-4fa18767d2f6', 'volume_size': 1} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-625551841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6422b45-9e98-4212-a0e4-4fa18767d2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4b4a818374673a9e4f1d4de60bc28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:03Z,use_quota=True,user_id='cb656269e31b4ee1be63f048eb13cc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Creating volume b6422b45-9e98-4212-a0e4-4fa18767d2f6 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:03 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b6422b45-9e98-4212-a0e4-4fa18767d2f6 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9f9967d4-e807-46e7-8f3d-15907fd006a6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:03 devstack sudo[88683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b6422b45-9e98-4212-a0e4-4fa18767d2f6 1073741824 Feb 27 02:08:03 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "cinder-quobyte-36a576c1-8170-449d-9464-e8f7a4975fea" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-quobyte-36a576c1-8170-449d-9464-e8f7a4975fea" acquired by "delete_volume" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[44830f12-9e1f-4a48-9a7f-b450af9fadc2]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-36a576c1-8170-449d-9464-e8f7a4975fea {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:03 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9f9967d4-e807-46e7-8f3d-15907fd006a6 Feb 27 02:08:03 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:03 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-36a576c1-8170-449d-9464-e8f7a4975fea Feb 27 02:08:03 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:04 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9f9967d4-e807-46e7-8f3d-15907fd006a6" returned: 0 in 0.573s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9f9967d4-e807-46e7-8f3d-15907fd006a6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:04 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9f9967d4-e807-46e7-8f3d-15907fd006a6 Feb 27 02:08:04 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:04 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-36a576c1-8170-449d-9464-e8f7a4975fea" returned: 0 in 0.594s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-36a576c1-8170-449d-9464-e8f7a4975fea {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:04 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b6422b45-9e98-4212-a0e4-4fa18767d2f6 1073741824" returned: 0 in 0.670s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:04 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-36a576c1-8170-449d-9464-e8f7a4975fea Feb 27 02:08:04 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b6422b45-9e98-4212-a0e4-4fa18767d2f6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:04 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b6422b45-9e98-4212-a0e4-4fa18767d2f6 Feb 27 02:08:04 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:04 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9f9967d4-e807-46e7-8f3d-15907fd006a6" returned: 0 in 0.565s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] Lock "cinder-quobyte-9f9967d4-e807-46e7-8f3d-15907fd006a6" released by "delete_volume" :: held 1.255s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:04 devstack cinder-volume[83231]: WARNING cinder.quota [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-414135714 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-414135714, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:08:04 devstack cinder-volume[83231]: WARNING cinder.quota [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-414135714 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-414135714, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:08:04 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] Created reservations ['57c70062-f997-4a24-b22c-0b4d663a81e1', '9a54b40b-f2cd-4681-8e1a-e6d699dc21c5', '31e98502-164c-42c9-8031-4b76bb3a4db8', '596e70a2-6e76-4223-a601-8efe2b98e55b'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-36a576c1-8170-449d-9464-e8f7a4975fea" returned: 0 in 0.584s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-quobyte-36a576c1-8170-449d-9464-e8f7a4975fea" released by "delete_volume" :: held 1.231s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:04 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b6422b45-9e98-4212-a0e4-4fa18767d2f6" returned: 0 in 0.596s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:04 devstack sudo[88707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:08:04 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d811cc20-2392-4661-b6ab-cab7cd314689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6422b45-9e98-4212-a0e4-4fa18767d2f6', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (651a6002-e3ba-4c35-9f36-a4767c00eacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:04 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Volume volume-b6422b45-9e98-4212-a0e4-4fa18767d2f6 (b6422b45-9e98-4212-a0e4-4fa18767d2f6): created successfully Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (651a6002-e3ba-4c35-9f36-a4767c00eacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Flow 'volume_create_manager' (5b6bf6d2-29fd-456a-9106-0d05a4c0b946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:04 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-99a85fc2-c731-4732-96d7-b5528b038cf5 tempest-VolumesActionsTest-1749971523 None] Created volume successfully. Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] Created reservations ['60b60e0d-6969-43ab-a3ba-a16dbb4f5760', 'fecfd4f2-c1f9-4985-bff0-5a1e0bd58a6f', 'd806bf61-3fe4-4bcc-9881-fcdee078f8ef', '994bff17-1d9f-4b2d-b5f6-c47b00a116d6'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:05 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:08:05 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:05 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.479s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:05 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] Deleted volume successfully. Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dbcf74bf-90a2-4495-8e74-045d6a6f268e tempest-VolumeTypesAccessTest-1285840269 None] Lock "cinder-9f9967d4-e807-46e7-8f3d-15907fd006a6-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:05 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.506s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:05 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] Deleted volume successfully. Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e05852e6-ffd6-4e19-8b4d-d98cabba5260 tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-36a576c1-8170-449d-9464-e8f7a4975fea-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "cinder-49e2ba39-3670-4916-841f-45bfef231e06-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-49e2ba39-3670-4916-841f-45bfef231e06-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "cinder-quobyte-49e2ba39-3670-4916-841f-45bfef231e06" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-quobyte-49e2ba39-3670-4916-841f-45bfef231e06" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] Acquiring lock "cinder-b6422b45-9e98-4212-a0e4-4fa18767d2f6-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda10573-8b79-46a4-8ec9-85a48a67e55a]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-49e2ba39-3670-4916-841f-45bfef231e06 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] Lock "cinder-b6422b45-9e98-4212-a0e4-4fa18767d2f6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] Acquiring lock "cinder-quobyte-b6422b45-9e98-4212-a0e4-4fa18767d2f6" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] Lock "cinder-quobyte-b6422b45-9e98-4212-a0e4-4fa18767d2f6" acquired by "delete_volume" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:05 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-49e2ba39-3670-4916-841f-45bfef231e06 Feb 27 02:08:05 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea585877-b2e0-417f-a901-91ed1819a934]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b6422b45-9e98-4212-a0e4-4fa18767d2f6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:06 devstack sudo[88715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b6422b45-9e98-4212-a0e4-4fa18767d2f6 Feb 27 02:08:06 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:06 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-49e2ba39-3670-4916-841f-45bfef231e06" returned: 0 in 0.797s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-49e2ba39-3670-4916-841f-45bfef231e06 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:06 devstack sudo[88724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-49e2ba39-3670-4916-841f-45bfef231e06 Feb 27 02:08:06 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:06 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b6422b45-9e98-4212-a0e4-4fa18767d2f6" returned: 0 in 0.778s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b6422b45-9e98-4212-a0e4-4fa18767d2f6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:06 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b6422b45-9e98-4212-a0e4-4fa18767d2f6 Feb 27 02:08:06 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:07 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-49e2ba39-3670-4916-841f-45bfef231e06" returned: 0 in 0.614s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-quobyte-49e2ba39-3670-4916-841f-45bfef231e06" released by "delete_volume" :: held 1.447s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] Created reservations ['08cf54fb-ea58-48f9-8d91-6da887347918', 'bc6d41c7-7221-400a-98f5-e56f6dca5928', '4215696e-1114-4f51-9a38-984abebac699', 'c8d974b8-39f9-474c-856a-80437c35156e'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:07 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b6422b45-9e98-4212-a0e4-4fa18767d2f6" returned: 0 in 0.654s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] Lock "cinder-quobyte-b6422b45-9e98-4212-a0e4-4fa18767d2f6" released by "delete_volume" :: held 1.474s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:07 devstack sudo[88730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:08:07 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] Created reservations ['8ab62413-71d3-4873-a3ff-29c53fdcd6f2', '85129904-77e4-4661-bb8e-d3d63d7eb641', 'f2a50d17-5dc8-4735-be26-f7cf239be787', '078f315a-09ef-4335-bd2c-b0fbeb764579'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:07 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:08:07 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:07 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.572s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:07 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] Deleted volume successfully. Feb 27 02:08:07 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-856aaaa4-c6c3-4aca-b179-8dfdcd3f9a0c tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-49e2ba39-3670-4916-841f-45bfef231e06-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "cinder-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "cinder-quobyte-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-quobyte-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3" acquired by "delete_volume" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9154b9-eabd-4c6b-b034-f72f3e6da3eb]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:08 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.639s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:08 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] Deleted volume successfully. Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-0c7bb085-747c-4485-b625-e9c8afdad950 tempest-VolumesActionsTest-1522634436 None] Lock "cinder-b6422b45-9e98-4212-a0e4-4fa18767d2f6-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:08 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3 Feb 27 02:08:08 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Flow 'volume_create_manager' (2b9db2fe-9ff0-4061-96a1-8aac49cd9363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0df8be-603c-43e9-bb79-53abffe0e14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0df8be-603c-43e9-bb79-53abffe0e14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-876994593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab61fdc-434a-4dd4-a06e-61f3a9d5f951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4b4a818374673a9e4f1d4de60bc28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:08Z,use_quota=True,user_id='cb656269e31b4ee1be63f048eb13cc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9eae4bd-bf79-4f7c-a7ee-2df843758219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9eae4bd-bf79-4f7c-a7ee-2df843758219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2dc772-b0de-4225-9cef-4a692473d274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2dc772-b0de-4225-9cef-4a692473d274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ab61fdc-434a-4dd4-a06e-61f3a9d5f951', 'volume_name': 'volume-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede91fe8-e0b5-4454-b533-a3900e8d98f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede91fe8-e0b5-4454-b533-a3900e8d98f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454ba072-9a9d-4417-a19b-39b8c1d61967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:08 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Volume 8ab61fdc-434a-4dd4-a06e-61f3a9d5f951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951', 'volume_size': 1} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-876994593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab61fdc-434a-4dd4-a06e-61f3a9d5f951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4b4a818374673a9e4f1d4de60bc28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:08Z,use_quota=True,user_id='cb656269e31b4ee1be63f048eb13cc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Creating volume 8ab61fdc-434a-4dd4-a06e-61f3a9d5f951 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:08 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:08 devstack sudo[88738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951 1073741824 Feb 27 02:08:08 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:08 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3" returned: 0 in 0.751s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:08 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3 Feb 27 02:08:08 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:09 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951 1073741824" returned: 0 in 0.872s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:09 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3" returned: 0 in 0.707s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:09 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-quobyte-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3" released by "delete_volume" :: held 1.504s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:09 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951 Feb 27 02:08:09 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:09 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] Created reservations ['afdc0208-e7e2-4b2e-985e-16642880e878', '81513d12-00d6-43ee-8f7b-9f731e9c7c48', '89cc62d5-51dd-482f-8717-a1e67253d88d', '1adc246b-0efc-435f-b32b-f81e5280b592'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:09 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:09 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:09 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:08:09 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:10 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951" returned: 0 in 0.732s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:10 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:10 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454ba072-9a9d-4417-a19b-39b8c1d61967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:10 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7732a2d9-2d03-45d8-8dc1-59f012a4fcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:10 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Volume volume-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951 (8ab61fdc-434a-4dd4-a06e-61f3a9d5f951): created successfully Feb 27 02:08:10 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7732a2d9-2d03-45d8-8dc1-59f012a4fcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:10 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Flow 'volume_create_manager' (2b9db2fe-9ff0-4061-96a1-8aac49cd9363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:10 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-d69f87ae-8a5b-49ef-90ee-b21b81696c1c tempest-VolumesActionsTest-1749971523 None] Created volume successfully. Feb 27 02:08:10 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.811s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:10 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:10 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] Deleted volume successfully. Feb 27 02:08:10 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c6d035b9-c14d-4193-8280-f43e650f9e89 tempest-CreateVolumesFromImageTest-481366762 None] Lock "cinder-2a4d942f-30b2-4fbb-b3fc-f371c708a8d3-delete_volume" released by "delete_volume" :: held 2.588s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:10 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] Acquiring lock "cinder-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:10 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] Lock "cinder-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:10 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] Acquiring lock "cinder-quobyte-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:10 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] Lock "cinder-quobyte-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951" acquired by "delete_volume" :: waited 0.021s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:10 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db3b8b8-9338-46ec-acce-2fc82eb4773b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:11 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951 Feb 27 02:08:11 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:11 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951" returned: 0 in 0.717s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:11 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951 Feb 27 02:08:11 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:12 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951" returned: 0 in 0.822s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:12 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] Lock "cinder-quobyte-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951" released by "delete_volume" :: held 1.601s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:12 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] Created reservations ['5528e5eb-a937-4ac9-9b21-8abc3df459d2', '36b96e67-e2c9-43e1-a384-2f458d4c94da', '36c3bcef-5f9a-4c60-8ee9-d83fa312dc79', '9babc0b8-73e0-4fe2-8c27-e1d0a1ec43ed'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:12 devstack sudo[88764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:08:12 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:13 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.684s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:13 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] Deleted volume successfully. Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Flow 'volume_create_manager' (a220b93e-56f8-4cd7-9f05-d4f7d8d668c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c5b75e-3526-462c-8bd6-bf9f51e289ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c5b75e-3526-462c-8bd6-bf9f51e289ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c887324d-c628-4231-acd0-2bd32c539e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54acf7303fc24356a1a9ac661e475401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:13Z,use_quota=True,user_id='47534e16177d48ccb5df6320c31300bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85daa5bc-3f14-4162-98fc-5533e106d240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85daa5bc-3f14-4162-98fc-5533e106d240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68a3994-8d0e-47b9-be4f-fbca2c98d693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68a3994-8d0e-47b9-be4f-fbca2c98d693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c887324d-c628-4231-acd0-2bd32c539e3c', 'volume_name': 'volume-c887324d-c628-4231-acd0-2bd32c539e3c', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98dfd7bb-6939-46a4-9dc4-950b10c5c29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98dfd7bb-6939-46a4-9dc4-950b10c5c29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25be8ac0-ff78-47f0-b4c6-ecbb554f1835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:13 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Volume c887324d-c628-4231-acd0-2bd32c539e3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c887324d-c628-4231-acd0-2bd32c539e3c', 'volume_size': 1} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c887324d-c628-4231-acd0-2bd32c539e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54acf7303fc24356a1a9ac661e475401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:13Z,use_quota=True,user_id='47534e16177d48ccb5df6320c31300bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Creating volume c887324d-c628-4231-acd0-2bd32c539e3c {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:13 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c887324d-c628-4231-acd0-2bd32c539e3c 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-76d5f282-bd70-4932-a370-d7b91762b547 tempest-VolumesActionsTest-1522634436 None] Lock "cinder-8ab61fdc-434a-4dd4-a06e-61f3a9d5f951-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:13 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c887324d-c628-4231-acd0-2bd32c539e3c 1073741824 Feb 27 02:08:13 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Flow 'volume_create_manager' (663ddb99-8930-4272-b26a-209c71cf4f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9b1da1-76d0-406f-902a-8d8e34ad4650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9b1da1-76d0-406f-902a-8d8e34ad4650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1463278937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79af4ba-d622-4066-bfdc-d8cbcf77174a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ab5ba7d9774de6ba69d299ad9bd3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:14Z,use_quota=True,user_id='bf52e4bbe16a4682adcb4f8c370c85cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef372784-a73b-46de-b58f-fc5f5475603a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef372784-a73b-46de-b58f-fc5f5475603a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4d3591-a984-414d-acc7-1fbeb76df3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4d3591-a984-414d-acc7-1fbeb76df3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f79af4ba-d622-4066-bfdc-d8cbcf77174a', 'volume_name': 'volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b006da9c-53ce-43ed-8fd7-e824fe42f6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b006da9c-53ce-43ed-8fd7-e824fe42f6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6eaa62-0dda-47fa-b2be-49803809f838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:13 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Volume f79af4ba-d622-4066-bfdc-d8cbcf77174a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a', 'volume_size': 1} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Flow 'volume_create_manager' (c2fe6de9-3f1d-468b-bea1-78d885f01c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba29309a-d894-4be5-93d0-9ce6afeb5fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba29309a-d894-4be5-93d0-9ce6afeb5fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1666913092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2beaac5b-f270-4d27-8250-0febf847c5ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4b4a818374673a9e4f1d4de60bc28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:14Z,use_quota=True,user_id='cb656269e31b4ee1be63f048eb13cc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d833a15-cc4f-42d0-9668-341f2c801dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d833a15-cc4f-42d0-9668-341f2c801dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb49f41-3e40-4737-a03e-4d53404520b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb49f41-3e40-4737-a03e-4d53404520b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2beaac5b-f270-4d27-8250-0febf847c5ab', 'volume_name': 'volume-2beaac5b-f270-4d27-8250-0febf847c5ab', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfae830a-9283-47f3-ae5e-c471bae38fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfae830a-9283-47f3-ae5e-c471bae38fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4703f190-7806-4d51-ac24-cf5e8eb6700b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:13 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Volume 2beaac5b-f270-4d27-8250-0febf847c5ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2beaac5b-f270-4d27-8250-0febf847c5ab', 'volume_size': 1} Feb 27 02:08:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:14 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c887324d-c628-4231-acd0-2bd32c539e3c 1073741824" returned: 0 in 0.699s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c887324d-c628-4231-acd0-2bd32c539e3c {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:14 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c887324d-c628-4231-acd0-2bd32c539e3c Feb 27 02:08:14 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:14 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c887324d-c628-4231-acd0-2bd32c539e3c" returned: 0 in 0.539s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.167s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1463278937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79af4ba-d622-4066-bfdc-d8cbcf77174a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ab5ba7d9774de6ba69d299ad9bd3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:14Z,use_quota=True,user_id='bf52e4bbe16a4682adcb4f8c370c85cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Creating volume f79af4ba-d622-4066-bfdc-d8cbcf77174a {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:14 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:08:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25be8ac0-ff78-47f0-b4c6-ecbb554f1835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c887324d-c628-4231-acd0-2bd32c539e3c', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4f6e6e-ae75-451e-a78b-9c087a30a9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:14 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a 1073741824 Feb 27 02:08:14 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:14 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Volume volume-c887324d-c628-4231-acd0-2bd32c539e3c (c887324d-c628-4231-acd0-2bd32c539e3c): created successfully Feb 27 02:08:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4f6e6e-ae75-451e-a78b-9c087a30a9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Flow 'volume_create_manager' (a220b93e-56f8-4cd7-9f05-d4f7d8d668c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:14 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-1f695f20-43ad-4bc0-9379-c23ce6f0249d tempest-CinderUnicodeTest-1100474360 None] Created volume successfully. Feb 27 02:08:15 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a 1073741824" returned: 0 in 0.656s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:15 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a Feb 27 02:08:15 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:15 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Flow 'volume_create_manager' (dd618265-68f8-4e36-bbb5-3c73280f8ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b5f390-fb17-47d4-8c73-d7ce4ed3878e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b5f390-fb17-47d4-8c73-d7ce4ed3878e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1406973494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241e2246-85ba-491e-bd88-7b42ab159f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54acf7303fc24356a1a9ac661e475401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:16Z,use_quota=True,user_id='47534e16177d48ccb5df6320c31300bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f7dd76-583f-4d66-a9cf-e009be8ffed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f7dd76-583f-4d66-a9cf-e009be8ffed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3984c86a-37eb-4327-8dca-1d5bdded0adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3984c86a-37eb-4327-8dca-1d5bdded0adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '241e2246-85ba-491e-bd88-7b42ab159f9d', 'volume_name': 'volume-241e2246-85ba-491e-bd88-7b42ab159f9d', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bffd99e-541b-473d-884b-0c4ebc644996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bffd99e-541b-473d-884b-0c4ebc644996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ef10f7-8e72-4796-97cb-ca68a2533841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:16 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Volume 241e2246-85ba-491e-bd88-7b42ab159f9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-241e2246-85ba-491e-bd88-7b42ab159f9d', 'volume_size': 1} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:16 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a" returned: 0 in 0.598s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.140s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1666913092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2beaac5b-f270-4d27-8250-0febf847c5ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4b4a818374673a9e4f1d4de60bc28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:14Z,use_quota=True,user_id='cb656269e31b4ee1be63f048eb13cc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Creating volume 2beaac5b-f270-4d27-8250-0febf847c5ab {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:16 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2beaac5b-f270-4d27-8250-0febf847c5ab 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6eaa62-0dda-47fa-b2be-49803809f838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:16 devstack sudo[88789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2beaac5b-f270-4d27-8250-0febf847c5ab 1073741824 Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d804f7b-2ccd-4247-8e73-8afcc3423144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:16 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:16 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Volume volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a (f79af4ba-d622-4066-bfdc-d8cbcf77174a): created successfully Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d804f7b-2ccd-4247-8e73-8afcc3423144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Flow 'volume_create_manager' (663ddb99-8930-4272-b26a-209c71cf4f37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:16 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-14f290fe-f5b8-46fc-a3c9-97c4a734e906 tempest-VolumesSnapshotTestJSON-1701854852 None] Created volume successfully. Feb 27 02:08:16 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2beaac5b-f270-4d27-8250-0febf847c5ab 1073741824" returned: 0 in 0.711s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2beaac5b-f270-4d27-8250-0febf847c5ab {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:16 devstack sudo[88794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2beaac5b-f270-4d27-8250-0febf847c5ab Feb 27 02:08:16 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Flow 'volume_create_manager' (186dea6c-4238-43ca-b0ce-8318f62000c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ec9ebc-5e03-40aa-8899-49f1b579c123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ec9ebc-5e03-40aa-8899-49f1b579c123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-5667854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd3b956-6131-4578-a2a4-ab78f0331183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e17ba7ed73b41c3b24f6176d6d32c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:17Z,use_quota=True,user_id='007598d962c642eea08f360b0b504fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5939b49c-7d3f-439d-b5b7-ba509f94a2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5939b49c-7d3f-439d-b5b7-ba509f94a2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a2c917-4cb2-44bc-a393-0923cacbb12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a2c917-4cb2-44bc-a393-0923cacbb12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd3b956-6131-4578-a2a4-ab78f0331183', 'volume_name': 'volume-4cd3b956-6131-4578-a2a4-ab78f0331183', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f34ef1-f67f-49b2-b18c-48f35e7037fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f34ef1-f67f-49b2-b18c-48f35e7037fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c2241e4-cf8a-43c3-9e1e-af694e01ee6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:16 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Volume 4cd3b956-6131-4578-a2a4-ab78f0331183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd3b956-6131-4578-a2a4-ab78f0331183', 'volume_size': 1} Feb 27 02:08:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-476fbc3a-ca3d-472d-ad6b-e92570e5ad8b tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:17 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2beaac5b-f270-4d27-8250-0febf847c5ab" returned: 0 in 0.541s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.320s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1406973494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241e2246-85ba-491e-bd88-7b42ab159f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54acf7303fc24356a1a9ac661e475401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:16Z,use_quota=True,user_id='47534e16177d48ccb5df6320c31300bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Creating volume 241e2246-85ba-491e-bd88-7b42ab159f9d {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:17 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4703f190-7806-4d51-ac24-cf5e8eb6700b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2beaac5b-f270-4d27-8250-0febf847c5ab', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:17 devstack sudo[88797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d 1073741824 Feb 27 02:08:17 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf47f77-5626-4745-8429-a0230da5b6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:17 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Volume volume-2beaac5b-f270-4d27-8250-0febf847c5ab (2beaac5b-f270-4d27-8250-0febf847c5ab): created successfully Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf47f77-5626-4745-8429-a0230da5b6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Flow 'volume_create_manager' (c2fe6de9-3f1d-468b-bea1-78d885f01c48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:17 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-318c8720-fecb-419d-975f-d7057824e0b7 tempest-VolumesActionsTest-1749971523 None] Created volume successfully. Feb 27 02:08:17 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d 1073741824" returned: 0 in 0.509s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:17 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d Feb 27 02:08:17 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] Acquiring lock "cinder-2beaac5b-f270-4d27-8250-0febf847c5ab-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] Lock "cinder-2beaac5b-f270-4d27-8250-0febf847c5ab-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] Acquiring lock "cinder-quobyte-2beaac5b-f270-4d27-8250-0febf847c5ab" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] Lock "cinder-quobyte-2beaac5b-f270-4d27-8250-0febf847c5ab" acquired by "delete_volume" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a2ebbc-d248-49d6-98ae-d4cd6a5b2002]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2beaac5b-f270-4d27-8250-0febf847c5ab {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:18 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d" returned: 0 in 0.511s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.467s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-5667854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd3b956-6131-4578-a2a4-ab78f0331183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e17ba7ed73b41c3b24f6176d6d32c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:17Z,use_quota=True,user_id='007598d962c642eea08f360b0b504fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Creating volume 4cd3b956-6131-4578-a2a4-ab78f0331183 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:18 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ef10f7-8e72-4796-97cb-ca68a2533841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-241e2246-85ba-491e-bd88-7b42ab159f9d', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:18 devstack sudo[88806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183 1073741824 Feb 27 02:08:18 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8319c9f-4fa9-4d9a-8eca-cf70b7dca210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:18 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Volume volume-241e2246-85ba-491e-bd88-7b42ab159f9d (241e2246-85ba-491e-bd88-7b42ab159f9d): created successfully Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8319c9f-4fa9-4d9a-8eca-cf70b7dca210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:18 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Flow 'volume_create_manager' (dd618265-68f8-4e36-bbb5-3c73280f8ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:18 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-130e7234-ba62-424b-92c6-aba6895f7f66 tempest-CinderUnicodeTest-1100474360 None] Created volume successfully. Feb 27 02:08:18 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2beaac5b-f270-4d27-8250-0febf847c5ab Feb 27 02:08:18 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:19 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2beaac5b-f270-4d27-8250-0febf847c5ab" returned: 0 in 0.646s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2beaac5b-f270-4d27-8250-0febf847c5ab {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:19 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2beaac5b-f270-4d27-8250-0febf847c5ab Feb 27 02:08:19 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:19 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183 1073741824" returned: 0 in 0.693s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:19 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183 Feb 27 02:08:19 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-3a1cb463-4e81-4441-a879-cd9c8abb2322 tempest-CinderUnicodeTest-1100474360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:19 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2beaac5b-f270-4d27-8250-0febf847c5ab" returned: 0 in 0.537s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] Lock "cinder-quobyte-2beaac5b-f270-4d27-8250-0febf847c5ab" released by "delete_volume" :: held 1.220s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] Created reservations ['96266cf8-9620-46fd-930d-4fc11bb49156', 'eb1b7bb0-ea7c-4a83-887e-8cb56baf4c33', '9f6dd003-64c7-484c-a28a-0d7c7f89c534', 'b596283c-c32e-45a1-aa9c-2bd24cd08405'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:19 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183" returned: 0 in 0.510s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-476fbc3a-ca3d-472d-ad6b-e92570e5ad8b tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.672s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c2241e4-cf8a-43c3-9e1e-af694e01ee6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd3b956-6131-4578-a2a4-ab78f0331183', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b0a3ed-8113-4642-908d-1168f77d0df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:19 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Volume volume-4cd3b956-6131-4578-a2a4-ab78f0331183 (4cd3b956-6131-4578-a2a4-ab78f0331183): created successfully Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b0a3ed-8113-4642-908d-1168f77d0df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Flow 'volume_create_manager' (186dea6c-4238-43ca-b0ce-8318f62000c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-476fbc3a-ca3d-472d-ad6b-e92570e5ad8b tempest-VolumesSnapshotTestJSON-1701854852 None] Creating offline snapshot 942951d9-e969-48f6-ae0a-bc4e117ca438 of volume f79af4ba-d622-4066-bfdc-d8cbcf77174a {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:19 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-ce84e388-7df4-4428-83d6-256ace3fb1a2 tempest-SnapshotMetadataTestJSON-294956107 None] Created volume successfully. Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae0d58e-8237-4789-a130-55e13c6fa96f]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-476fbc3a-ca3d-472d-ad6b-e92570e5ad8b tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:19 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:08:19 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:19 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a Feb 27 02:08:19 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8c3c1a0c-f742-4257-ac38-4a314fa823dd tempest-SnapshotMetadataTestJSON-294956107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:20 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.578s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:20 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] Deleted volume successfully. Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3f4f684c-af9e-4c0f-a655-f5937bb25f6e tempest-VolumesActionsTest-1522634436 None] Lock "cinder-2beaac5b-f270-4d27-8250-0febf847c5ab-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:20 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-476fbc3a-ca3d-472d-ad6b-e92570e5ad8b tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a" returned: 0 in 0.647s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-476fbc3a-ca3d-472d-ad6b-e92570e5ad8b tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:20 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438 1G Feb 27 02:08:20 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Flow 'volume_create_manager' (5357b26a-5389-4351-8d3b-6683015cb2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebcbaefe-9f23-490c-b31b-267b9feea3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebcbaefe-9f23-490c-b31b-267b9feea3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-727664974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ceebdb-6125-4486-983e-6d3bb2273948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4b4a818374673a9e4f1d4de60bc28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:21Z,use_quota=True,user_id='cb656269e31b4ee1be63f048eb13cc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4cabb6-a5ff-4680-ae98-69cdf266ae7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4cabb6-a5ff-4680-ae98-69cdf266ae7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6185849c-f5b8-4382-b2c3-4d5c009941ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6185849c-f5b8-4382-b2c3-4d5c009941ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6ceebdb-6125-4486-983e-6d3bb2273948', 'volume_name': 'volume-a6ceebdb-6125-4486-983e-6d3bb2273948', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19f9402-587d-4d83-9d23-2a2f873f7720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19f9402-587d-4d83-9d23-2a2f873f7720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0db5e7-2ef1-4eec-9bac-15c1b1c772dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:20 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Volume a6ceebdb-6125-4486-983e-6d3bb2273948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6ceebdb-6125-4486-983e-6d3bb2273948', 'volume_size': 1} Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:20 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-476fbc3a-ca3d-472d-ad6b-e92570e5ad8b tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438 1G" returned: 0 in 0.555s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-476fbc3a-ca3d-472d-ad6b-e92570e5ad8b tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:20 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438 Feb 27 02:08:20 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:21 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-476fbc3a-ca3d-472d-ad6b-e92570e5ad8b tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438" returned: 0 in 0.462s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:21 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-476fbc3a-ca3d-472d-ad6b-e92570e5ad8b tempest-VolumesSnapshotTestJSON-1701854852 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438 is being set with open permissions: ugo+rw Feb 27 02:08:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-476fbc3a-ca3d-472d-ad6b-e92570e5ad8b tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:21 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438 Feb 27 02:08:21 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:21 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-476fbc3a-ca3d-472d-ad6b-e92570e5ad8b tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438" returned: 0 in 0.461s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-476fbc3a-ca3d-472d-ad6b-e92570e5ad8b tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:21 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.info Feb 27 02:08:21 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:22 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-476fbc3a-ca3d-472d-ad6b-e92570e5ad8b tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.info" returned: 0 in 0.480s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:22 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-476fbc3a-ca3d-472d-ad6b-e92570e5ad8b tempest-VolumesSnapshotTestJSON-1701854852 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.info is being set with open permissions: ugo+rw Feb 27 02:08:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-476fbc3a-ca3d-472d-ad6b-e92570e5ad8b tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:22 devstack sudo[88879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.info Feb 27 02:08:22 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:22 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-476fbc3a-ca3d-472d-ad6b-e92570e5ad8b tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.info" returned: 0 in 0.482s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-476fbc3a-ca3d-472d-ad6b-e92570e5ad8b tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.207s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-3a1cb463-4e81-4441-a879-cd9c8abb2322 tempest-CinderUnicodeTest-1100474360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.489s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:22 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-3a1cb463-4e81-4441-a879-cd9c8abb2322 tempest-CinderUnicodeTest-1100474360 None] Creating offline snapshot 68f17bb7-88ac-4b16-9f8c-4bb2e5b45292 of volume 241e2246-85ba-491e-bd88-7b42ab159f9d {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:22 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a479e41-b9f8-4749-bc69-47f35e4c27ba]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3a1cb463-4e81-4441-a879-cd9c8abb2322 tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:22 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-476fbc3a-ca3d-472d-ad6b-e92570e5ad8b tempest-VolumesSnapshotTestJSON-1701854852 None] Create snapshot completed successfully Feb 27 02:08:23 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d Feb 27 02:08:23 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-942951d9-e969-48f6-ae0a-bc4e117ca438-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-942951d9-e969-48f6-ae0a-bc4e117ca438-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-quobyte-f79af4ba-d622-4066-bfdc-d8cbcf77174a" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-f79af4ba-d622-4066-bfdc-d8cbcf77174a" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-quobyte-942951d9-e969-48f6-ae0a-bc4e117ca438" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-942951d9-e969-48f6-ae0a-bc4e117ca438" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] Deleting offline snapshot 942951d9-e969-48f6-ae0a-bc4e117ca438 of volume f79af4ba-d622-4066-bfdc-d8cbcf77174a {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:08:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] snapshot_file for this snap is: volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:08:23 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fbf198-1118-4675-83e1-b98f32c9d819]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:23 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438 Feb 27 02:08:23 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:23 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3a1cb463-4e81-4441-a879-cd9c8abb2322 tempest-CinderUnicodeTest-1100474360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d" returned: 0 in 0.563s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3a1cb463-4e81-4441-a879-cd9c8abb2322 tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:23 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292 1G Feb 27 02:08:23 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:23 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438" returned: 0 in 0.542s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:23 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f2b5d7-f812-4230-baa6-7f81fd110877]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:24 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3a1cb463-4e81-4441-a879-cd9c8abb2322 tempest-CinderUnicodeTest-1100474360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292 1G" returned: 0 in 0.521s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3a1cb463-4e81-4441-a879-cd9c8abb2322 tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241e2246-85ba-491e-bd88-7b42ab159f9d -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:24 devstack sudo[88898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a Feb 27 02:08:24 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:24 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241e2246-85ba-491e-bd88-7b42ab159f9d -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292 Feb 27 02:08:24 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:24 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a" returned: 0 in 0.505s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:24 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438 Feb 27 02:08:24 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:24 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3a1cb463-4e81-4441-a879-cd9c8abb2322 tempest-CinderUnicodeTest-1100474360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241e2246-85ba-491e-bd88-7b42ab159f9d -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292" returned: 0 in 0.492s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:24 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-3a1cb463-4e81-4441-a879-cd9c8abb2322 tempest-CinderUnicodeTest-1100474360 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292 is being set with open permissions: ugo+rw Feb 27 02:08:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3a1cb463-4e81-4441-a879-cd9c8abb2322 tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:24 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292 Feb 27 02:08:24 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:24 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:24 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3a1cb463-4e81-4441-a879-cd9c8abb2322 tempest-CinderUnicodeTest-1100474360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292" returned: 0 in 0.434s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438" returned: 0 in 0.494s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:24 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438 Feb 27 02:08:24 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3a1cb463-4e81-4441-a879-cd9c8abb2322 tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:25 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.info Feb 27 02:08:25 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:25 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3a1cb463-4e81-4441-a879-cd9c8abb2322 tempest-CinderUnicodeTest-1100474360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.info" returned: 0 in 0.427s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:25 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-3a1cb463-4e81-4441-a879-cd9c8abb2322 tempest-CinderUnicodeTest-1100474360 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.info is being set with open permissions: ugo+rw Feb 27 02:08:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3a1cb463-4e81-4441-a879-cd9c8abb2322 tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:25 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a.942951d9-e969-48f6-ae0a-bc4e117ca438" returned: 0 in 0.475s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:25 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.info Feb 27 02:08:25 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:25 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-942951d9-e969-48f6-ae0a-bc4e117ca438" released by "_delete_snapshot" :: held 2.077s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:25 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-f79af4ba-d622-4066-bfdc-d8cbcf77174a" released by "delete_snapshot" :: held 2.089s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:25 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] Created reservations ['d0c93727-71a3-4127-b46e-62e2fa84892b', 'e89d1007-0efd-478c-9695-1f7a88655b78', '7e5b6152-5019-4803-8018-0e6b2c956998', '140d67b1-1ece-4610-ab28-27d5f576ca9a'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:25 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] Delete snapshot completed successfully. Feb 27 02:08:25 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7c345135-487c-43a5-95af-d51c907f2340 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-942951d9-e969-48f6-ae0a-bc4e117ca438-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:25 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3a1cb463-4e81-4441-a879-cd9c8abb2322 tempest-CinderUnicodeTest-1100474360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.info" returned: 0 in 0.420s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-3a1cb463-4e81-4441-a879-cd9c8abb2322 tempest-CinderUnicodeTest-1100474360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.959s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8c3c1a0c-f742-4257-ac38-4a314fa823dd tempest-SnapshotMetadataTestJSON-294956107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.616s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:25 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-8c3c1a0c-f742-4257-ac38-4a314fa823dd tempest-SnapshotMetadataTestJSON-294956107 None] Creating offline snapshot d19fb484-b87e-4641-9ecc-756288c5a930 of volume 4cd3b956-6131-4578-a2a4-ab78f0331183 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:25 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6fb0c2-a342-46ba-8efb-a6447b4fb65f]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8c3c1a0c-f742-4257-ac38-4a314fa823dd tempest-SnapshotMetadataTestJSON-294956107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:25 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-3a1cb463-4e81-4441-a879-cd9c8abb2322 tempest-CinderUnicodeTest-1100474360 None] Create snapshot completed successfully Feb 27 02:08:25 devstack sudo[88925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183 Feb 27 02:08:25 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:26 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8c3c1a0c-f742-4257-ac38-4a314fa823dd tempest-SnapshotMetadataTestJSON-294956107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183" returned: 0 in 0.528s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8c3c1a0c-f742-4257-ac38-4a314fa823dd tempest-SnapshotMetadataTestJSON-294956107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:26 devstack sudo[88930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930 1G Feb 27 02:08:26 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] Acquiring lock "cinder-68f17bb7-88ac-4b16-9f8c-4bb2e5b45292-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] Lock "cinder-68f17bb7-88ac-4b16-9f8c-4bb2e5b45292-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] Acquiring lock "cinder-quobyte-241e2246-85ba-491e-bd88-7b42ab159f9d" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] Lock "cinder-quobyte-241e2246-85ba-491e-bd88-7b42ab159f9d" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] Acquiring lock "cinder-quobyte-68f17bb7-88ac-4b16-9f8c-4bb2e5b45292" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] Lock "cinder-quobyte-68f17bb7-88ac-4b16-9f8c-4bb2e5b45292" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] Deleting offline snapshot 68f17bb7-88ac-4b16-9f8c-4bb2e5b45292 of volume 241e2246-85ba-491e-bd88-7b42ab159f9d {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] snapshot_file for this snap is: volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[389e2302-1058-4b0e-9bf0-fcec56f2acbf]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:26 devstack sudo[88932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292 Feb 27 02:08:26 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Flow 'volume_create_manager' (ef837bcd-65cc-4d7a-b80d-8af43d0074a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46ec663-1ddd-4494-831f-a552e51437dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46ec663-1ddd-4494-831f-a552e51437dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2026596133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70684427-612d-437b-bfa1-4aea631be029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ab5ba7d9774de6ba69d299ad9bd3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:27Z,use_quota=True,user_id='bf52e4bbe16a4682adcb4f8c370c85cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5cd8e06-2957-4193-8898-982d072aefa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5cd8e06-2957-4193-8898-982d072aefa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604e12d9-a540-44cd-972a-9e61199ba9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604e12d9-a540-44cd-972a-9e61199ba9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70684427-612d-437b-bfa1-4aea631be029', 'volume_name': 'volume-70684427-612d-437b-bfa1-4aea631be029', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459e75f3-bb0e-4e06-9493-0a9b89c917ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459e75f3-bb0e-4e06-9493-0a9b89c917ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f920a4b-d776-4129-8046-cebeb622d35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:26 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Volume 70684427-612d-437b-bfa1-4aea631be029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70684427-612d-437b-bfa1-4aea631be029', 'volume_size': 1} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:26 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8c3c1a0c-f742-4257-ac38-4a314fa823dd tempest-SnapshotMetadataTestJSON-294956107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930 1G" returned: 0 in 0.550s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8c3c1a0c-f742-4257-ac38-4a314fa823dd tempest-SnapshotMetadataTestJSON-294956107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd3b956-6131-4578-a2a4-ab78f0331183 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:26 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd3b956-6131-4578-a2a4-ab78f0331183 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930 Feb 27 02:08:26 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:27 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292" returned: 0 in 0.550s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:27 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-241e2246-85ba-491e-bd88-7b42ab159f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:27 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[674ddad3-dc40-4a1f-a0dc-3c4b47ac3e5b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:27 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d Feb 27 02:08:27 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:27 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8c3c1a0c-f742-4257-ac38-4a314fa823dd tempest-SnapshotMetadataTestJSON-294956107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd3b956-6131-4578-a2a4-ab78f0331183 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930" returned: 0 in 0.475s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:27 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-8c3c1a0c-f742-4257-ac38-4a314fa823dd tempest-SnapshotMetadataTestJSON-294956107 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930 is being set with open permissions: ugo+rw Feb 27 02:08:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8c3c1a0c-f742-4257-ac38-4a314fa823dd tempest-SnapshotMetadataTestJSON-294956107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:27 devstack sudo[88947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930 Feb 27 02:08:27 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:27 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d" returned: 0 in 0.548s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:27 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292 Feb 27 02:08:27 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:27 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8c3c1a0c-f742-4257-ac38-4a314fa823dd tempest-SnapshotMetadataTestJSON-294956107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930" returned: 0 in 0.466s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8c3c1a0c-f742-4257-ac38-4a314fa823dd tempest-SnapshotMetadataTestJSON-294956107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:27 devstack sudo[88955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.info Feb 27 02:08:27 devstack sudo[88955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:28 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292" returned: 0 in 0.520s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:28 devstack sudo[88955]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:28 devstack sudo[88961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292 Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8c3c1a0c-f742-4257-ac38-4a314fa823dd tempest-SnapshotMetadataTestJSON-294956107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.info" returned: 0 in 0.459s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:28 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:28 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-8c3c1a0c-f742-4257-ac38-4a314fa823dd tempest-SnapshotMetadataTestJSON-294956107 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.info is being set with open permissions: ugo+rw Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8c3c1a0c-f742-4257-ac38-4a314fa823dd tempest-SnapshotMetadataTestJSON-294956107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:28 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.info Feb 27 02:08:28 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:28 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:28 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d.68f17bb7-88ac-4b16-9f8c-4bb2e5b45292" returned: 0 in 0.472s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8c3c1a0c-f742-4257-ac38-4a314fa823dd tempest-SnapshotMetadataTestJSON-294956107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.info" returned: 0 in 0.457s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8c3c1a0c-f742-4257-ac38-4a314fa823dd tempest-SnapshotMetadataTestJSON-294956107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.998s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.930s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-727664974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ceebdb-6125-4486-983e-6d3bb2273948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4b4a818374673a9e4f1d4de60bc28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:21Z,use_quota=True,user_id='cb656269e31b4ee1be63f048eb13cc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Creating volume a6ceebdb-6125-4486-983e-6d3bb2273948 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:28 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-a6ceebdb-6125-4486-983e-6d3bb2273948 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:28 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-a6ceebdb-6125-4486-983e-6d3bb2273948 1073741824 Feb 27 02:08:28 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] Lock "cinder-quobyte-68f17bb7-88ac-4b16-9f8c-4bb2e5b45292" released by "_delete_snapshot" :: held 2.203s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] Lock "cinder-quobyte-241e2246-85ba-491e-bd88-7b42ab159f9d" released by "delete_snapshot" :: held 2.223s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:28 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-8c3c1a0c-f742-4257-ac38-4a314fa823dd tempest-SnapshotMetadataTestJSON-294956107 None] Create snapshot completed successfully Feb 27 02:08:28 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] Created reservations ['6688d182-5733-413d-a098-a829a8df6e4a', 'd3907277-dbb4-4cad-b2d6-00ec6b18c97d', '497caf69-fcf2-4344-8ae6-9180de9a237e', '11a77127-b479-467a-8edd-aba5151705f0'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:29 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] Delete snapshot completed successfully. Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-92c44bda-400b-493f-a5aa-b4c3499850d7 tempest-CinderUnicodeTest-1100474360 None] Lock "cinder-68f17bb7-88ac-4b16-9f8c-4bb2e5b45292-delete_snapshot" released by "delete_snapshot" :: held 2.340s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:29 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-a6ceebdb-6125-4486-983e-6d3bb2273948 1073741824" returned: 0 in 0.524s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-a6ceebdb-6125-4486-983e-6d3bb2273948 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:29 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-a6ceebdb-6125-4486-983e-6d3bb2273948 Feb 27 02:08:29 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] Acquiring lock "cinder-241e2246-85ba-491e-bd88-7b42ab159f9d-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] Lock "cinder-241e2246-85ba-491e-bd88-7b42ab159f9d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] Acquiring lock "cinder-quobyte-241e2246-85ba-491e-bd88-7b42ab159f9d" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] Lock "cinder-quobyte-241e2246-85ba-491e-bd88-7b42ab159f9d" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:29 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-a6ceebdb-6125-4486-983e-6d3bb2273948" returned: 0 in 0.500s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0989269e-f90e-4002-bc4f-5fdf302bba1a]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.988s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2026596133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70684427-612d-437b-bfa1-4aea631be029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ab5ba7d9774de6ba69d299ad9bd3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:27Z,use_quota=True,user_id='bf52e4bbe16a4682adcb4f8c370c85cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Creating volume 70684427-612d-437b-bfa1-4aea631be029 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:29 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:29 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 1073741824 Feb 27 02:08:29 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0db5e7-2ef1-4eec-9bac-15c1b1c772dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6ceebdb-6125-4486-983e-6d3bb2273948', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a236c442-a10e-424f-bdc7-8c11a5e24173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:29 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Volume volume-a6ceebdb-6125-4486-983e-6d3bb2273948 (a6ceebdb-6125-4486-983e-6d3bb2273948): created successfully Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a236c442-a10e-424f-bdc7-8c11a5e24173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Flow 'volume_create_manager' (5357b26a-5389-4351-8d3b-6683015cb2e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:30 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-90dd1ef1-ed2b-4aae-92e2-59d064626263 tempest-VolumesActionsTest-1749971523 None] Created volume successfully. Feb 27 02:08:30 devstack sudo[88976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d Feb 27 02:08:30 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] Acquiring lock "cinder-d19fb484-b87e-4641-9ecc-756288c5a930-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] Lock "cinder-d19fb484-b87e-4641-9ecc-756288c5a930-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] Acquiring lock "cinder-quobyte-4cd3b956-6131-4578-a2a4-ab78f0331183" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] Lock "cinder-quobyte-4cd3b956-6131-4578-a2a4-ab78f0331183" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] Acquiring lock "cinder-quobyte-d19fb484-b87e-4641-9ecc-756288c5a930" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] Lock "cinder-quobyte-d19fb484-b87e-4641-9ecc-756288c5a930" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] Deleting offline snapshot d19fb484-b87e-4641-9ecc-756288c5a930 of volume 4cd3b956-6131-4578-a2a4-ab78f0331183 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] snapshot_file for this snap is: volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0a344a-ce9e-4ff1-8d64-7bcdfcfa1fc7]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:30 devstack sudo[88979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930 Feb 27 02:08:30 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:30 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d" returned: 0 in 0.603s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:30 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 1073741824" returned: 0 in 0.632s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:30 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d Feb 27 02:08:30 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:30 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 Feb 27 02:08:30 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:30 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930" returned: 0 in 0.642s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cd3b956-6131-4578-a2a4-ab78f0331183(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fab7f5-77a6-4788-b174-5947bafa3d24]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] Acquiring lock "cinder-a6ceebdb-6125-4486-983e-6d3bb2273948-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] Lock "cinder-a6ceebdb-6125-4486-983e-6d3bb2273948-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:31 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183 Feb 27 02:08:31 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] Acquiring lock "cinder-quobyte-a6ceebdb-6125-4486-983e-6d3bb2273948" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] Lock "cinder-quobyte-a6ceebdb-6125-4486-983e-6d3bb2273948" acquired by "delete_volume" :: waited 0.016s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f18c9e6-1175-4150-b00d-b31bc84b5a1e]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-a6ceebdb-6125-4486-983e-6d3bb2273948 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:31 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-241e2246-85ba-491e-bd88-7b42ab159f9d" returned: 0 in 0.566s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:31 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] Lock "cinder-quobyte-241e2246-85ba-491e-bd88-7b42ab159f9d" released by "delete_volume" :: held 1.227s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029" returned: 0 in 0.536s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:31 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-a6ceebdb-6125-4486-983e-6d3bb2273948 Feb 27 02:08:31 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f920a4b-d776-4129-8046-cebeb622d35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70684427-612d-437b-bfa1-4aea631be029', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a155c4-3d20-4dc3-be56-7332a0c37135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:31 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Volume volume-70684427-612d-437b-bfa1-4aea631be029 (70684427-612d-437b-bfa1-4aea631be029): created successfully Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a155c4-3d20-4dc3-be56-7332a0c37135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Flow 'volume_create_manager' (ef837bcd-65cc-4d7a-b80d-8af43d0074a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:31 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-2beba048-2130-4392-8623-a658222874ab tempest-VolumesSnapshotTestJSON-1701854852 None] Created volume successfully. Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] Created reservations ['6e06d034-9bd0-43e9-9ebf-4489c494fad3', '806a742e-c7c4-4ce3-a8bf-9fb79c121163', 'c9eb6b87-bab1-4ca4-a993-2da4f9909f2c', '9bf7a682-122e-43a9-bca8-658349b95fb4'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:31 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:08:31 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:31 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183" returned: 0 in 0.640s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:31 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930 Feb 27 02:08:31 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:31 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-a6ceebdb-6125-4486-983e-6d3bb2273948" returned: 0 in 0.564s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-a6ceebdb-6125-4486-983e-6d3bb2273948 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:31 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-a6ceebdb-6125-4486-983e-6d3bb2273948 Feb 27 02:08:31 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:31 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.427s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:31 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] Deleted volume successfully. Feb 27 02:08:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-367701aa-31c1-471a-9b03-770097550100 tempest-CinderUnicodeTest-1100474360 None] Lock "cinder-241e2246-85ba-491e-bd88-7b42ab159f9d-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:32 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] Acquiring lock "cinder-c887324d-c628-4231-acd0-2bd32c539e3c-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930" returned: 0 in 0.536s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] Lock "cinder-c887324d-c628-4231-acd0-2bd32c539e3c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:32 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-a6ceebdb-6125-4486-983e-6d3bb2273948" returned: 0 in 0.481s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:32 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930 Feb 27 02:08:32 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] Lock "cinder-quobyte-a6ceebdb-6125-4486-983e-6d3bb2273948" released by "delete_volume" :: held 1.090s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] Acquiring lock "cinder-quobyte-c887324d-c628-4231-acd0-2bd32c539e3c" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] Lock "cinder-quobyte-c887324d-c628-4231-acd0-2bd32c539e3c" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c209e4-4bd6-4839-b17c-c142505bc6bf]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c887324d-c628-4231-acd0-2bd32c539e3c {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] Created reservations ['5eab64f5-bf77-45bd-b181-e4f1446183bb', 'b71244ac-4603-4b29-b6e8-aa2eb3b47156', '959a9bf4-0fb4-409b-9e31-53877c943c9f', '1926bfde-8711-4aa9-940e-1bd53d896491'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:32 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c887324d-c628-4231-acd0-2bd32c539e3c Feb 27 02:08:32 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-818be8a8-195e-4120-96b1-21cb0e46a6e0 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-818be8a8-195e-4120-96b1-21cb0e46a6e0 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:32 devstack sudo[89021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:08:32 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-818be8a8-195e-4120-96b1-21cb0e46a6e0 tempest-VolumesSnapshotTestJSON-1701854852 None] Creating offline snapshot dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e of volume 70684427-612d-437b-bfa1-4aea631be029 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3570dfb-e4d8-4d0f-9a4d-1ab85d6cba93]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-818be8a8-195e-4120-96b1-21cb0e46a6e0 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:32 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 Feb 27 02:08:32 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:32 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183.d19fb484-b87e-4641-9ecc-756288c5a930" returned: 0 in 0.598s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] Lock "cinder-quobyte-d19fb484-b87e-4641-9ecc-756288c5a930" released by "_delete_snapshot" :: held 2.511s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] Lock "cinder-quobyte-4cd3b956-6131-4578-a2a4-ab78f0331183" released by "delete_snapshot" :: held 2.525s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] Created reservations ['4dfb5ab5-b74e-4232-a782-12e0e8704f02', '1459a6c2-401f-4a2a-8cbd-e1ebe9ce9aa9', 'd372a84d-0dad-4e78-af6c-a68887300709', '7be0422c-84b9-4e26-a3d7-f28e23a639dd'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:32 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] Delete snapshot completed successfully. Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-55b6241d-a6ca-4b4d-81ff-ec7db31fffa0 tempest-SnapshotMetadataTestJSON-294956107 None] Lock "cinder-d19fb484-b87e-4641-9ecc-756288c5a930-delete_snapshot" released by "delete_snapshot" :: held 2.635s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:32 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c887324d-c628-4231-acd0-2bd32c539e3c" returned: 0 in 0.615s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c887324d-c628-4231-acd0-2bd32c539e3c {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:32 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c887324d-c628-4231-acd0-2bd32c539e3c Feb 27 02:08:32 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:32 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.505s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:32 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] Deleted volume successfully. Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-0399cf80-b772-46e5-b0ef-371b1981b446 tempest-VolumesActionsTest-1749971523 None] Lock "cinder-a6ceebdb-6125-4486-983e-6d3bb2273948-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:32 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-818be8a8-195e-4120-96b1-21cb0e46a6e0 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029" returned: 0 in 0.585s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-818be8a8-195e-4120-96b1-21cb0e46a6e0 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:33 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e 1G Feb 27 02:08:33 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:33 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c887324d-c628-4231-acd0-2bd32c539e3c" returned: 0 in 0.487s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] Lock "cinder-quobyte-c887324d-c628-4231-acd0-2bd32c539e3c" released by "delete_volume" :: held 1.149s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:33 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] Created reservations ['3bdbaf64-f9c0-4b2b-a7be-a6a4d84c60cb', '15e9a2b9-c852-4635-b2e8-7403c99ed651', '51ae27a4-b536-4ac1-9eda-1d41ecc5d1d0', '3afb05dd-a46e-4a00-8394-662d9cb1e4df'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] Acquiring lock "cinder-4cd3b956-6131-4578-a2a4-ab78f0331183-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:33 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:33 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] Lock "cinder-4cd3b956-6131-4578-a2a4-ab78f0331183-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:33 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:08:33 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] Acquiring lock "cinder-quobyte-4cd3b956-6131-4578-a2a4-ab78f0331183" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] Lock "cinder-quobyte-4cd3b956-6131-4578-a2a4-ab78f0331183" acquired by "delete_volume" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:33 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89dd037-a40e-4c92-96ec-0e08b141aaaf]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:33 devstack sudo[89044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183 Feb 27 02:08:33 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:33 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-818be8a8-195e-4120-96b1-21cb0e46a6e0 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e 1G" returned: 0 in 0.699s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-818be8a8-195e-4120-96b1-21cb0e46a6e0 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70684427-612d-437b-bfa1-4aea631be029 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:33 devstack sudo[89046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70684427-612d-437b-bfa1-4aea631be029 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e Feb 27 02:08:33 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:34 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.695s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:34 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:34 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] Deleted volume successfully. Feb 27 02:08:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b1d3cbc6-fe71-442c-a376-c87e3f7d1d85 tempest-CinderUnicodeTest-1100474360 None] Lock "cinder-c887324d-c628-4231-acd0-2bd32c539e3c-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:34 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183" returned: 0 in 0.690s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:34 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183 Feb 27 02:08:34 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:34 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-818be8a8-195e-4120-96b1-21cb0e46a6e0 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70684427-612d-437b-bfa1-4aea631be029 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e" returned: 0 in 0.667s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:34 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-818be8a8-195e-4120-96b1-21cb0e46a6e0 tempest-VolumesSnapshotTestJSON-1701854852 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e is being set with open permissions: ugo+rw Feb 27 02:08:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-818be8a8-195e-4120-96b1-21cb0e46a6e0 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:34 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e Feb 27 02:08:34 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:34 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-4cd3b956-6131-4578-a2a4-ab78f0331183" returned: 0 in 0.625s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] Lock "cinder-quobyte-4cd3b956-6131-4578-a2a4-ab78f0331183" released by "delete_volume" :: held 1.358s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:34 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] Created reservations ['780fc43a-c61d-4b32-8872-930be52c23c2', '432b435b-c7ab-41fc-89f8-f278679cea7b', '053d727f-5881-4deb-b6ec-ace0589a6eee', '76ed8442-9768-4298-9a3e-0c3142432d6b'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:35 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:08:35 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:35 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-818be8a8-195e-4120-96b1-21cb0e46a6e0 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e" returned: 0 in 0.724s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-818be8a8-195e-4120-96b1-21cb0e46a6e0 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:35 devstack sudo[89064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.info Feb 27 02:08:35 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:35 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.567s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:35 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:35 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] Deleted volume successfully. Feb 27 02:08:35 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2684374a-f693-410a-8b55-db0c06ebda0b tempest-SnapshotMetadataTestJSON-294956107 None] Lock "cinder-4cd3b956-6131-4578-a2a4-ab78f0331183-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:35 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-818be8a8-195e-4120-96b1-21cb0e46a6e0 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.info" returned: 0 in 0.679s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:35 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-818be8a8-195e-4120-96b1-21cb0e46a6e0 tempest-VolumesSnapshotTestJSON-1701854852 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.info is being set with open permissions: ugo+rw Feb 27 02:08:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-818be8a8-195e-4120-96b1-21cb0e46a6e0 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:35 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.info Feb 27 02:08:35 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:36 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-818be8a8-195e-4120-96b1-21cb0e46a6e0 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.info" returned: 0 in 0.604s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-818be8a8-195e-4120-96b1-21cb0e46a6e0 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.032s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:36 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-818be8a8-195e-4120-96b1-21cb0e46a6e0 tempest-VolumesSnapshotTestJSON-1701854852 None] Create snapshot completed successfully Feb 27 02:08:36 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:36 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Flow 'volume_create_manager' (bd66f626-5648-41d6-9636-7c2a90569645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:36 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c2d395-438b-4ff8-babe-f03f60325742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c2d395-438b-4ff8-babe-f03f60325742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2104789154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91204c31-408f-4282-8f18-ff73a7105de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ab5ba7d9774de6ba69d299ad9bd3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:37Z,use_quota=True,user_id='bf52e4bbe16a4682adcb4f8c370c85cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b91cdd1-62c6-4f4f-8412-fca6f4353007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b91cdd1-62c6-4f4f-8412-fca6f4353007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fbe58b-7558-401a-897a-0e2fc8d15645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fbe58b-7558-401a-897a-0e2fc8d15645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '91204c31-408f-4282-8f18-ff73a7105de1', 'volume_name': 'volume-91204c31-408f-4282-8f18-ff73a7105de1', 'volume_size': 2, 'snapshot_id': 'dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a179de8-59ef-4b31-a63d-600466235a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a179de8-59ef-4b31-a63d-600466235a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70eae65d-570a-49f9-a6b8-54e158ca62db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:37 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Volume 91204c31-408f-4282-8f18-ff73a7105de1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-91204c31-408f-4282-8f18-ff73a7105de1', 'volume_size': 2, 'snapshot_id': 'dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e'} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-quobyte-dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e-91204c31-408f-4282-8f18-ff73a7105de1" by "_create_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e-91204c31-408f-4282-8f18-ff73a7105de1" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Creating volume 91204c31-408f-4282-8f18-ff73a7105de1 from snapshot dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e {{(pid=83231) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-quobyte-91204c31-408f-4282-8f18-ff73a7105de1" by "_copy_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-91204c31-408f-4282-8f18-ff73a7105de1" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] snapshot: dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e, volume: 91204c31-408f-4282-8f18-ff73a7105de1, {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a09b781-fbd8-4d68-bfe8-a3bd9b7bd511]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:37 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e Feb 27 02:08:37 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Flow 'volume_create_manager' (04c40bbd-a1b2-41bb-ad0f-0b9c5953bb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28bde76-52b1-4f58-bbb2-cf8f0e73a263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28bde76-52b1-4f58-bbb2-cf8f0e73a263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-987646370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f351941-ab9e-4282-b844-eb0194f8ce3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='006294543f104c0ab6ab768773901c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:38Z,use_quota=True,user_id='3c098451548f4b95a5d9757dadf0b861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76034c1-8e40-4e83-9c2d-22958d407bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76034c1-8e40-4e83-9c2d-22958d407bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb274e9-16d2-4fcd-8980-53cd2695b882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb274e9-16d2-4fcd-8980-53cd2695b882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f351941-ab9e-4282-b844-eb0194f8ce3b', 'volume_name': 'volume-0f351941-ab9e-4282-b844-eb0194f8ce3b', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ffe7fc-050f-4c65-a745-6dda4834aa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ffe7fc-050f-4c65-a745-6dda4834aa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:37 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9f6d1f-4854-4883-94e9-efc1e2f82dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:37 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Volume 0f351941-ab9e-4282-b844-eb0194f8ce3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f351941-ab9e-4282-b844-eb0194f8ce3b', 'volume_size': 1} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e" returned: 0 in 0.691s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70684427-612d-437b-bfa1-4aea631be029(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Creating direct copy from snapshot {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7fd26f-00ba-4aa4-a83b-ae995e8231fb]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:37 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 Feb 27 02:08:37 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:38 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029" returned: 0 in 0.599s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:38 devstack cinder-volume[83231]: DEBUG cinder.utils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Path /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-91204c31-408f-4282-8f18-ff73a7105de1 not found in is_blk_device check {{(pid=83231) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:08:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-91204c31-408f-4282-8f18-ff73a7105de1 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:38 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-91204c31-408f-4282-8f18-ff73a7105de1 Feb 27 02:08:38 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:40 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-91204c31-408f-4282-8f18-ff73a7105de1" returned: 0 in 2.256s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:40 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f51ce8d-93e0-4a9f-ae18-e2f09b4d681c]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:40 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 Feb 27 02:08:40 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:41 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029" returned: 0 in 0.683s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Image conversion details: src /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029, size 1024.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-91204c31-408f-4282-8f18-ff73a7105de1 {{(pid=83231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:08:41 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Converted 1024.00 MB image at 453.66 MB/s Feb 27 02:08:41 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-91204c31-408f-4282-8f18-ff73a7105de1 is being set with open permissions: ugo+rw Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-91204c31-408f-4282-8f18-ff73a7105de1 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:41 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-91204c31-408f-4282-8f18-ff73a7105de1 Feb 27 02:08:41 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:41 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-91204c31-408f-4282-8f18-ff73a7105de1" returned: 0 in 0.464s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-91204c31-408f-4282-8f18-ff73a7105de1" released by "_copy_volume_from_snapshot" :: held 4.777s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e-91204c31-408f-4282-8f18-ff73a7105de1" released by "_create_volume_from_snapshot" :: held 4.802s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.813s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.056s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-987646370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f351941-ab9e-4282-b844-eb0194f8ce3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='006294543f104c0ab6ab768773901c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:38Z,use_quota=True,user_id='3c098451548f4b95a5d9757dadf0b861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Creating volume 0f351941-ab9e-4282-b844-eb0194f8ce3b {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:41 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f351941-ab9e-4282-b844-eb0194f8ce3b 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:41 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f351941-ab9e-4282-b844-eb0194f8ce3b 1073741824 Feb 27 02:08:41 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70eae65d-570a-49f9-a6b8-54e158ca62db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91204c31-408f-4282-8f18-ff73a7105de1', 'volume_size': 2, 'snapshot_id': 'dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec61661-b98f-4c00-b024-44d3dc22c7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:41 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Volume volume-91204c31-408f-4282-8f18-ff73a7105de1 (91204c31-408f-4282-8f18-ff73a7105de1): created successfully Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec61661-b98f-4c00-b024-44d3dc22c7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Flow 'volume_create_manager' (bd66f626-5648-41d6-9636-7c2a90569645) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:41 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b0b216a4-e1b6-4fd5-b196-0d17e7e928d1 tempest-VolumesSnapshotTestJSON-1701854852 None] Created volume successfully. Feb 27 02:08:42 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f351941-ab9e-4282-b844-eb0194f8ce3b 1073741824" returned: 0 in 0.632s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:42 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=167,cinder:UPDATE=210,cinder:INSERT=57,cinder:DELETE=21 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:08:42 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=177,cinder:UPDATE=247,cinder:INSERT=52,cinder:DELETE=19 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:08:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f351941-ab9e-4282-b844-eb0194f8ce3b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:42 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f351941-ab9e-4282-b844-eb0194f8ce3b Feb 27 02:08:42 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-91204c31-408f-4282-8f18-ff73a7105de1-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-91204c31-408f-4282-8f18-ff73a7105de1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-quobyte-91204c31-408f-4282-8f18-ff73a7105de1" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-91204c31-408f-4282-8f18-ff73a7105de1" acquired by "delete_volume" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:42 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d2abd1-34aa-4a3a-8164-2b0e3c9884fc]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-91204c31-408f-4282-8f18-ff73a7105de1 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:42 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-91204c31-408f-4282-8f18-ff73a7105de1 Feb 27 02:08:42 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:43 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f351941-ab9e-4282-b844-eb0194f8ce3b" returned: 0 in 0.570s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:43 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:43 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9f6d1f-4854-4883-94e9-efc1e2f82dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f351941-ab9e-4282-b844-eb0194f8ce3b', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:43 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bdf804-c262-45d6-a9bc-065d78a8fd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:43 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Volume volume-0f351941-ab9e-4282-b844-eb0194f8ce3b (0f351941-ab9e-4282-b844-eb0194f8ce3b): created successfully Feb 27 02:08:43 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bdf804-c262-45d6-a9bc-065d78a8fd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:43 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Flow 'volume_create_manager' (04c40bbd-a1b2-41bb-ad0f-0b9c5953bb94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:43 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-71b186a5-49f4-4b35-bd0b-975ce368dfa8 tempest-VolumesMetadataTest-431933301 None] Created volume successfully. Feb 27 02:08:43 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-91204c31-408f-4282-8f18-ff73a7105de1" returned: 0 in 0.636s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-91204c31-408f-4282-8f18-ff73a7105de1 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:43 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-91204c31-408f-4282-8f18-ff73a7105de1 Feb 27 02:08:43 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:43 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-91204c31-408f-4282-8f18-ff73a7105de1" returned: 0 in 0.551s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:43 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-91204c31-408f-4282-8f18-ff73a7105de1" released by "delete_volume" :: held 1.211s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:43 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] Created reservations ['a2a305ea-b6af-40d1-a39f-345e33779987', '5574d561-7ef6-4fc3-be24-7e64f3531ade', 'd0366474-b796-4872-865b-3976ded5cc04', 'd46aa683-2ce4-4718-ada3-cbe7721477ba'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:43 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:43 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:44 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:08:44 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:44 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.531s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:44 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:44 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] Deleted volume successfully. Feb 27 02:08:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e1f54c48-850a-4db6-8fd1-0069c786745a tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-91204c31-408f-4282-8f18-ff73a7105de1-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-quobyte-70684427-612d-437b-bfa1-4aea631be029" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-70684427-612d-437b-bfa1-4aea631be029" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-quobyte-dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:44 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] Deleting offline snapshot dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e of volume 70684427-612d-437b-bfa1-4aea631be029 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:08:44 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] snapshot_file for this snap is: volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:08:44 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30b41c0-6a41-433f-a3af-3eb61c06a14d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:45 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e Feb 27 02:08:45 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] Acquiring lock "cinder-0f351941-ab9e-4282-b844-eb0194f8ce3b-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] Lock "cinder-0f351941-ab9e-4282-b844-eb0194f8ce3b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] Acquiring lock "cinder-quobyte-0f351941-ab9e-4282-b844-eb0194f8ce3b" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] Lock "cinder-quobyte-0f351941-ab9e-4282-b844-eb0194f8ce3b" acquired by "delete_volume" :: waited 0.020s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f4d7a3-b0d3-437a-9e20-156c0e1533e6]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f351941-ab9e-4282-b844-eb0194f8ce3b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:45 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f351941-ab9e-4282-b844-eb0194f8ce3b Feb 27 02:08:45 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:45 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e" returned: 0 in 0.679s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70684427-612d-437b-bfa1-4aea631be029(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[990fd556-093d-46fc-a9d8-0912a12f1d44]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:45 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f351941-ab9e-4282-b844-eb0194f8ce3b" returned: 0 in 0.580s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f351941-ab9e-4282-b844-eb0194f8ce3b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:45 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 Feb 27 02:08:45 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:45 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f351941-ab9e-4282-b844-eb0194f8ce3b Feb 27 02:08:45 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Flow 'volume_create_manager' (b5c2ed83-0f04-4cee-9983-523f390ed13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d35d3b-f499-43bb-ac9f-085969848139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d35d3b-f499-43bb-ac9f-085969848139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1692371988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44fe188e-dcc5-4c99-91bd-7a166eba9579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d3a51f93c47ab92ec3227dc2be52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:46Z,use_quota=True,user_id='1406bf69f091429a9ad5ab549613957e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f02c52-f728-47ac-aa70-15808c93fcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f02c52-f728-47ac-aa70-15808c93fcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1394b306-bfa1-4032-8992-889906a1dfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1394b306-bfa1-4032-8992-889906a1dfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44fe188e-dcc5-4c99-91bd-7a166eba9579', 'volume_name': 'volume-44fe188e-dcc5-4c99-91bd-7a166eba9579', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2a90e6-6617-4ff5-bf2e-6c174886e463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2a90e6-6617-4ff5-bf2e-6c174886e463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7653e89-81f3-4b6b-b4fd-b2c301d1a759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Volume 44fe188e-dcc5-4c99-91bd-7a166eba9579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44fe188e-dcc5-4c99-91bd-7a166eba9579', 'volume_size': 1} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1692371988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44fe188e-dcc5-4c99-91bd-7a166eba9579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d3a51f93c47ab92ec3227dc2be52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:46Z,use_quota=True,user_id='1406bf69f091429a9ad5ab549613957e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Creating volume 44fe188e-dcc5-4c99-91bd-7a166eba9579 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:45 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:08:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-44fe188e-dcc5-4c99-91bd-7a166eba9579 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:45 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-44fe188e-dcc5-4c99-91bd-7a166eba9579 1073741824 Feb 27 02:08:45 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:46 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0f351941-ab9e-4282-b844-eb0194f8ce3b" returned: 0 in 0.480s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:46 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] Lock "cinder-quobyte-0f351941-ab9e-4282-b844-eb0194f8ce3b" released by "delete_volume" :: held 1.090s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029" returned: 0 in 0.585s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:46 devstack sudo[89144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e Feb 27 02:08:46 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] Created reservations ['6e96dccd-f19b-4440-8a2a-6dbdacdd456f', 'bb599f78-f023-47cc-a279-2b2a60eac5b8', '7baa744f-16f0-4281-9f5d-523e3a95bbb0', 'a8ed4374-2149-4266-8f77-e7c5c9b3b32b'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:46 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:08:46 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:46 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-44fe188e-dcc5-4c99-91bd-7a166eba9579 1073741824" returned: 0 in 0.553s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-44fe188e-dcc5-4c99-91bd-7a166eba9579 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:46 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-44fe188e-dcc5-4c99-91bd-7a166eba9579 Feb 27 02:08:46 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:46 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.478s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:46 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] Deleted volume successfully. Feb 27 02:08:46 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4f5546ed-190c-4242-9eb4-02ec409f3ef5 tempest-VolumesMetadataTest-431933301 None] Lock "cinder-0f351941-ab9e-4282-b844-eb0194f8ce3b-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e" returned: 0 in 0.592s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:46 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e Feb 27 02:08:46 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:46 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-44fe188e-dcc5-4c99-91bd-7a166eba9579" returned: 0 in 0.438s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7653e89-81f3-4b6b-b4fd-b2c301d1a759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44fe188e-dcc5-4c99-91bd-7a166eba9579', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7387c83-aef4-439d-aa0e-efffa292bb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:46 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Volume volume-44fe188e-dcc5-4c99-91bd-7a166eba9579 (44fe188e-dcc5-4c99-91bd-7a166eba9579): created successfully Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7387c83-aef4-439d-aa0e-efffa292bb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:46 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Flow 'volume_create_manager' (b5c2ed83-0f04-4cee-9983-523f390ed13f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:47 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-faac670f-e9f7-43fa-8a6f-dbbf8c408ebe tempest-AbsoluteLimitsTests-1041769704 None] Created volume successfully. Feb 27 02:08:47 devstack cinder-volume[83231]: DEBUG oslo_service.periodic_task [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83231) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:08:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:47 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029.dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e" returned: 0 in 0.440s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:47 devstack sudo[89161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:08:47 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:47 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e" released by "_delete_snapshot" :: held 2.379s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:47 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-70684427-612d-437b-bfa1-4aea631be029" released by "delete_snapshot" :: held 2.396s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:47 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] Created reservations ['708a6064-867e-4b08-95c6-a31182832076', '44a56d73-1e99-4f6c-86e4-cbfc31bab30e', '5c6de752-5967-4cb6-9e1c-926489f792c2', 'e6947c00-7265-49d2-ae77-6ffe9e0c4f83'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:47 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] Delete snapshot completed successfully. Feb 27 02:08:47 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e8f54bbe-ec68-4891-b499-c305c1ca88af tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-dc2b590a-4f81-4cd6-b3c7-96b5fe4a768e-delete_snapshot" released by "delete_snapshot" :: held 2.498s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:47 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.553s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:47 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-70684427-612d-437b-bfa1-4aea631be029-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-70684427-612d-437b-bfa1-4aea631be029-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-quobyte-70684427-612d-437b-bfa1-4aea631be029" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] Acquiring lock "cinder-44fe188e-dcc5-4c99-91bd-7a166eba9579-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-70684427-612d-437b-bfa1-4aea631be029" acquired by "delete_volume" :: waited 0.027s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] Lock "cinder-44fe188e-dcc5-4c99-91bd-7a166eba9579-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:48 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad86188a-f2bb-45e6-ac89-11d94df6a1b1]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] Acquiring lock "cinder-quobyte-44fe188e-dcc5-4c99-91bd-7a166eba9579" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] Lock "cinder-quobyte-44fe188e-dcc5-4c99-91bd-7a166eba9579" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:48 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b46f197-51b4-4fff-b9a0-00cd6a2fbba2]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-44fe188e-dcc5-4c99-91bd-7a166eba9579 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:48 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 Feb 27 02:08:48 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:48 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-44fe188e-dcc5-4c99-91bd-7a166eba9579 Feb 27 02:08:48 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:48 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029" returned: 0 in 0.539s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:48 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029 Feb 27 02:08:48 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:48 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-44fe188e-dcc5-4c99-91bd-7a166eba9579" returned: 0 in 0.624s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-44fe188e-dcc5-4c99-91bd-7a166eba9579 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:48 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-44fe188e-dcc5-4c99-91bd-7a166eba9579 Feb 27 02:08:48 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:49 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-70684427-612d-437b-bfa1-4aea631be029" returned: 0 in 0.519s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-70684427-612d-437b-bfa1-4aea631be029" released by "delete_volume" :: held 1.119s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] Created reservations ['f833806a-aff8-40ff-98b2-b7d84fdbb3b9', '194b24e5-533a-4ba6-b238-439fae29afa8', 'b03699b3-dd77-4967-9782-af50f01aed20', '88855675-5fde-4483-a942-44f11b9254ef'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:49 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-44fe188e-dcc5-4c99-91bd-7a166eba9579" returned: 0 in 0.513s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:49 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:08:49 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] Lock "cinder-quobyte-44fe188e-dcc5-4c99-91bd-7a166eba9579" released by "delete_volume" :: held 1.163s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] Created reservations ['a79ac597-39e3-4c8b-bc69-a86174156e2d', 'c9a4dbb7-02a7-4f0f-95f3-e0f0f582199f', '5385f43f-d584-4db3-a158-2096404ceeac', '21b13638-0fe7-4720-80bb-9a3f67e0f6c7'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:49 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:08:49 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Flow 'volume_create_manager' (05a0aa9f-dd54-4886-a91b-4b110121186e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251e04ef-a1b6-4bcd-a4c9-7a3e122101fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251e04ef-a1b6-4bcd-a4c9-7a3e122101fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1848759453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04c377f-3ca3-488c-8ad9-e9acaedcd0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044234e51711400ca72006434244cb94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:50Z,use_quota=True,user_id='23787f60831d4232ba43ecd9f2316b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eac0708-0095-41f2-bcc0-52539eb2f93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eac0708-0095-41f2-bcc0-52539eb2f93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f3352d-afce-477c-80c0-d9b4f4227f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f3352d-afce-477c-80c0-d9b4f4227f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e04c377f-3ca3-488c-8ad9-e9acaedcd0f3', 'volume_name': 'volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3', 'volume_size': 2}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b92c709-7d66-4e9b-846e-75656617f2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b92c709-7d66-4e9b-846e-75656617f2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c90a520-5bb4-4da5-ba69-84a9fb0035a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:49 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Volume e04c377f-3ca3-488c-8ad9-e9acaedcd0f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3', 'volume_size': 2} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1848759453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04c377f-3ca3-488c-8ad9-e9acaedcd0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044234e51711400ca72006434244cb94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:50Z,use_quota=True,user_id='23787f60831d4232ba43ecd9f2316b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Creating volume e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:49 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 2147483648 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:49 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 2147483648 Feb 27 02:08:49 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:49 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.442s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:49 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] Deleted volume successfully. Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dfd6a754-22db-4a10-a38f-888ddfbcecc4 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-70684427-612d-437b-bfa1-4aea631be029-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:49 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.449s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:49 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] Deleted volume successfully. Feb 27 02:08:49 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-816ccd04-ae34-4d0d-a981-17b593128c8e tempest-AbsoluteLimitsTests-1041769704 None] Lock "cinder-44fe188e-dcc5-4c99-91bd-7a166eba9579-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:50 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 2147483648" returned: 0 in 0.529s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:50 devstack sudo[89191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 Feb 27 02:08:50 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Flow 'volume_create_manager' (8e70cd95-735c-4228-a09f-78d8700a37d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d094e7a0-d516-4032-b141-28f2622da46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d094e7a0-d516-4032-b141-28f2622da46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1160021006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f84976df-6dbe-4ce5-b45c-d7aac9639366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ab5ba7d9774de6ba69d299ad9bd3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:51Z,use_quota=True,user_id='bf52e4bbe16a4682adcb4f8c370c85cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89002582-a9ce-41ba-83a9-ede4e9083d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89002582-a9ce-41ba-83a9-ede4e9083d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10452446-e0bd-492b-86ba-5212deb3f7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10452446-e0bd-492b-86ba-5212deb3f7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f84976df-6dbe-4ce5-b45c-d7aac9639366', 'volume_name': 'volume-f84976df-6dbe-4ce5-b45c-d7aac9639366', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21b23df-fe39-4828-a63c-d6b0361d81c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21b23df-fe39-4828-a63c-d6b0361d81c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92abafae-2fc7-404e-a895-91242dd1bf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:50 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Volume f84976df-6dbe-4ce5-b45c-d7aac9639366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f84976df-6dbe-4ce5-b45c-d7aac9639366', 'volume_size': 1} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:50 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3" returned: 0 in 0.512s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.017s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1160021006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f84976df-6dbe-4ce5-b45c-d7aac9639366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ab5ba7d9774de6ba69d299ad9bd3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:51Z,use_quota=True,user_id='bf52e4bbe16a4682adcb4f8c370c85cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Creating volume f84976df-6dbe-4ce5-b45c-d7aac9639366 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:50 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c90a520-5bb4-4da5-ba69-84a9fb0035a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3', 'volume_size': 2}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a2ccdf-8e17-42e7-82ff-7ea9e093afff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:50 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 1073741824 Feb 27 02:08:50 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:50 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Volume volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 (e04c377f-3ca3-488c-8ad9-e9acaedcd0f3): created successfully Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a2ccdf-8e17-42e7-82ff-7ea9e093afff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Flow 'volume_create_manager' (05a0aa9f-dd54-4886-a91b-4b110121186e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:50 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-2bc5cc5f-7fce-46da-afb8-d87bb79c22fe tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Created volume successfully. Feb 27 02:08:51 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 1073741824" returned: 0 in 0.571s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:51 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 Feb 27 02:08:51 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:51 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366" returned: 0 in 0.491s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:51 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92abafae-2fc7-404e-a895-91242dd1bf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f84976df-6dbe-4ce5-b45c-d7aac9639366', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f2eb08-e474-4e35-9619-18a595823444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:51 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Volume volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 (f84976df-6dbe-4ce5-b45c-d7aac9639366): created successfully Feb 27 02:08:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f2eb08-e474-4e35-9619-18a595823444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:51 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Flow 'volume_create_manager' (8e70cd95-735c-4228-a09f-78d8700a37d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:51 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b22c975a-0d80-4ee8-950f-9e29f0513747 tempest-VolumesSnapshotTestJSON-1701854852 None] Created volume successfully. Feb 27 02:08:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-caaf80f1-9274-45e6-8e13-f3178bcc4cda tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-caaf80f1-9274-45e6-8e13-f3178bcc4cda tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:51 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-caaf80f1-9274-45e6-8e13-f3178bcc4cda tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Creating offline snapshot bb85f814-a01e-42a7-aa1c-d98920b8e5d3 of volume e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:51 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e4d7a3-f9db-426c-a54e-4bc7d608dbac]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-caaf80f1-9274-45e6-8e13-f3178bcc4cda tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:52 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 Feb 27 02:08:52 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:52 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-caaf80f1-9274-45e6-8e13-f3178bcc4cda tempest-VolumesSnapshotNegativeTestJSON-175795354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3" returned: 0 in 0.632s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-caaf80f1-9274-45e6-8e13-f3178bcc4cda tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3 2G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:52 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3 2G Feb 27 02:08:52 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-723073e4-dae7-45e0-a241-d3d9e5f73dda tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:53 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-caaf80f1-9274-45e6-8e13-f3178bcc4cda tempest-VolumesSnapshotNegativeTestJSON-175795354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3 2G" returned: 0 in 0.640s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-caaf80f1-9274-45e6-8e13-f3178bcc4cda tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:53 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3 Feb 27 02:08:53 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:53 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-caaf80f1-9274-45e6-8e13-f3178bcc4cda tempest-VolumesSnapshotNegativeTestJSON-175795354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3" returned: 0 in 0.484s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:53 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-caaf80f1-9274-45e6-8e13-f3178bcc4cda tempest-VolumesSnapshotNegativeTestJSON-175795354 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3 is being set with open permissions: ugo+rw Feb 27 02:08:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-caaf80f1-9274-45e6-8e13-f3178bcc4cda tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:53 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3 Feb 27 02:08:53 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:54 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-caaf80f1-9274-45e6-8e13-f3178bcc4cda tempest-VolumesSnapshotNegativeTestJSON-175795354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3" returned: 0 in 0.460s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-caaf80f1-9274-45e6-8e13-f3178bcc4cda tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:54 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.info Feb 27 02:08:54 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:54 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Flow 'volume_create_manager' (0d0935e3-0650-4112-a820-0b9596fe014f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc7531f-ec55-434c-920a-05d793e38bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc7531f-ec55-434c-920a-05d793e38bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-872695744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5c91f3-b177-4401-914c-f7a05b0fc78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ea34f2f4014bbe8d40b14a2e10aa96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:54Z,use_quota=True,user_id='e8fd90df456941e98b5131dc49aff6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7098f7-27b3-4f46-b69a-017b210e2689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7098f7-27b3-4f46-b69a-017b210e2689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02bc79b5-69cc-440d-8975-8ada3412ec1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02bc79b5-69cc-440d-8975-8ada3412ec1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb5c91f3-b177-4401-914c-f7a05b0fc78f', 'volume_name': 'volume-bb5c91f3-b177-4401-914c-f7a05b0fc78f', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e14a00e-2648-4edc-9c66-16322b3866fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e14a00e-2648-4edc-9c66-16322b3866fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ee78c9-a9f7-411e-931b-86bd0cfbc6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:54 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Volume bb5c91f3-b177-4401-914c-f7a05b0fc78f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb5c91f3-b177-4401-914c-f7a05b0fc78f', 'volume_size': 1} Feb 27 02:08:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:54 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-caaf80f1-9274-45e6-8e13-f3178bcc4cda tempest-VolumesSnapshotNegativeTestJSON-175795354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.info" returned: 0 in 0.452s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:54 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-caaf80f1-9274-45e6-8e13-f3178bcc4cda tempest-VolumesSnapshotNegativeTestJSON-175795354 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.info is being set with open permissions: ugo+rw Feb 27 02:08:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-caaf80f1-9274-45e6-8e13-f3178bcc4cda tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:54 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.info Feb 27 02:08:54 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:55 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-caaf80f1-9274-45e6-8e13-f3178bcc4cda tempest-VolumesSnapshotNegativeTestJSON-175795354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.info" returned: 0 in 0.497s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-caaf80f1-9274-45e6-8e13-f3178bcc4cda tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.235s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-723073e4-dae7-45e0-a241-d3d9e5f73dda tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.195s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-723073e4-dae7-45e0-a241-d3d9e5f73dda tempest-VolumesSnapshotTestJSON-1701854852 None] Creating offline snapshot deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 of volume f84976df-6dbe-4ce5-b45c-d7aac9639366 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:55 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-caaf80f1-9274-45e6-8e13-f3178bcc4cda tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Create snapshot completed successfully Feb 27 02:08:55 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0dc3a9-406c-4525-b237-6b1d4a2a4b7c]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-723073e4-dae7-45e0-a241-d3d9e5f73dda tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:55 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 Feb 27 02:08:55 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:55 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-723073e4-dae7-45e0-a241-d3d9e5f73dda tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366" returned: 0 in 0.483s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-723073e4-dae7-45e0-a241-d3d9e5f73dda tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:55 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 1G Feb 27 02:08:55 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:56 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Acquiring lock "cinder-bb85f814-a01e-42a7-aa1c-d98920b8e5d3-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:56 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Lock "cinder-bb85f814-a01e-42a7-aa1c-d98920b8e5d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:56 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Acquiring lock "cinder-quobyte-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:56 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Lock "cinder-quobyte-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:56 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Acquiring lock "cinder-quobyte-bb85f814-a01e-42a7-aa1c-d98920b8e5d3" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:56 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Lock "cinder-quobyte-bb85f814-a01e-42a7-aa1c-d98920b8e5d3" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:56 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Deleting offline snapshot bb85f814-a01e-42a7-aa1c-d98920b8e5d3 of volume e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:08:56 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] snapshot_file for this snap is: volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:08:56 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:56 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa590a47-4c89-47ec-ac41-4ddc1f00ccd7]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-723073e4-dae7-45e0-a241-d3d9e5f73dda tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 1G" returned: 0 in 0.572s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-723073e4-dae7-45e0-a241-d3d9e5f73dda tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:56 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 Feb 27 02:08:56 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:56 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3 Feb 27 02:08:56 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:56 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-723073e4-dae7-45e0-a241-d3d9e5f73dda tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2" returned: 0 in 0.471s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:56 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-723073e4-dae7-45e0-a241-d3d9e5f73dda tempest-VolumesSnapshotTestJSON-1701854852 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 is being set with open permissions: ugo+rw Feb 27 02:08:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-723073e4-dae7-45e0-a241-d3d9e5f73dda tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:56 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 Feb 27 02:08:56 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:56 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3" returned: 0 in 0.535s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:56 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:56 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba4c04e-99f7-4fd7-89fb-ed3b48ed6c4c]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:56 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 Feb 27 02:08:56 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:57 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-723073e4-dae7-45e0-a241-d3d9e5f73dda tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2" returned: 0 in 0.476s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-723073e4-dae7-45e0-a241-d3d9e5f73dda tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:57 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.info Feb 27 02:08:57 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:57 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3" returned: 0 in 0.567s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:57 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3 Feb 27 02:08:57 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:57 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-723073e4-dae7-45e0-a241-d3d9e5f73dda tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.info" returned: 0 in 0.506s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:57 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-723073e4-dae7-45e0-a241-d3d9e5f73dda tempest-VolumesSnapshotTestJSON-1701854852 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.info is being set with open permissions: ugo+rw Feb 27 02:08:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-723073e4-dae7-45e0-a241-d3d9e5f73dda tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:57 devstack sudo[89264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.info Feb 27 02:08:57 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:57 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3" returned: 0 in 0.515s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:57 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3 Feb 27 02:08:57 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:58 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-723073e4-dae7-45e0-a241-d3d9e5f73dda tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.info" returned: 0 in 0.469s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-723073e4-dae7-45e0-a241-d3d9e5f73dda tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.068s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.797s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-872695744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5c91f3-b177-4401-914c-f7a05b0fc78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ea34f2f4014bbe8d40b14a2e10aa96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:54Z,use_quota=True,user_id='e8fd90df456941e98b5131dc49aff6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Creating volume bb5c91f3-b177-4401-914c-f7a05b0fc78f {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:58 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:08:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bb5c91f3-b177-4401-914c-f7a05b0fc78f 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:58 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-723073e4-dae7-45e0-a241-d3d9e5f73dda tempest-VolumesSnapshotTestJSON-1701854852 None] Create snapshot completed successfully Feb 27 02:08:58 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bb5c91f3-b177-4401-914c-f7a05b0fc78f 1073741824 Feb 27 02:08:58 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:58 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3.bb85f814-a01e-42a7-aa1c-d98920b8e5d3" returned: 0 in 0.515s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Lock "cinder-quobyte-bb85f814-a01e-42a7-aa1c-d98920b8e5d3" released by "_delete_snapshot" :: held 2.199s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Lock "cinder-quobyte-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3" released by "delete_snapshot" :: held 2.231s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:58 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Created reservations ['75678424-fa74-4777-9d78-361811f3fcab', '5506ca27-b527-4f35-8f49-42d7969bc4c7', 'c0af5075-3585-45de-b157-3b49ef90b0b3', '6f4e8c9a-7345-48a2-95fa-c762568c1f7c'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:58 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Delete snapshot completed successfully. Feb 27 02:08:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-20a7e260-bd2e-4f17-b83c-4c280a611880 tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Lock "cinder-bb85f814-a01e-42a7-aa1c-d98920b8e5d3-delete_snapshot" released by "delete_snapshot" :: held 2.334s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:58 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bb5c91f3-b177-4401-914c-f7a05b0fc78f 1073741824" returned: 0 in 0.535s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bb5c91f3-b177-4401-914c-f7a05b0fc78f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:58 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bb5c91f3-b177-4401-914c-f7a05b0fc78f Feb 27 02:08:58 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:59 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bb5c91f3-b177-4401-914c-f7a05b0fc78f" returned: 0 in 0.551s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ee78c9-a9f7-411e-931b-86bd0cfbc6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb5c91f3-b177-4401-914c-f7a05b0fc78f', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e23f53-aaa2-49eb-8950-96c4741ae9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:59 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Volume volume-bb5c91f3-b177-4401-914c-f7a05b0fc78f (bb5c91f3-b177-4401-914c-f7a05b0fc78f): created successfully Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e23f53-aaa2-49eb-8950-96c4741ae9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Flow 'volume_create_manager' (0d0935e3-0650-4112-a820-0b9596fe014f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:59 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b0bb3014-d638-429a-9e72-bb99e5ebe87a tempest-VolumesTransfersV357Test-1038709327 None] Created volume successfully. Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Acquiring lock "cinder-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Lock "cinder-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Acquiring lock "cinder-quobyte-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Lock "cinder-quobyte-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3" acquired by "delete_volume" :: waited 0.018s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf250a92-98a9-43fb-9051-cb36163c2223]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Flow 'volume_create_manager' (a13697ff-d454-42c3-9ed1-efff1bd2b7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c08e678-9b00-42ff-b31a-b0766e235ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c08e678-9b00-42ff-b31a-b0766e235ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-227859382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1245878f-d1ee-4052-a36d-8f79efa043e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ab5ba7d9774de6ba69d299ad9bd3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=deeb649e-e974-4e15-b9af-e2b3fc1fcfb2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:59Z,use_quota=True,user_id='bf52e4bbe16a4682adcb4f8c370c85cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c72043-a989-475b-a9b7-1dc5d97ad8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:59 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 Feb 27 02:08:59 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c72043-a989-475b-a9b7-1dc5d97ad8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a12158-ee20-44ae-83b0-b3b0e5a9f2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a12158-ee20-44ae-83b0-b3b0e5a9f2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1245878f-d1ee-4052-a36d-8f79efa043e1', 'volume_name': 'volume-1245878f-d1ee-4052-a36d-8f79efa043e1', 'volume_size': 1, 'snapshot_id': 'deeb649e-e974-4e15-b9af-e2b3fc1fcfb2'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b6458e-c4c7-4321-bbfe-7b1f9635ce9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b6458e-c4c7-4321-bbfe-7b1f9635ce9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8ae5b7-ee84-4589-b9fe-0602800e22e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:59 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Volume 1245878f-d1ee-4052-a36d-8f79efa043e1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1245878f-d1ee-4052-a36d-8f79efa043e1', 'volume_size': 1, 'snapshot_id': 'deeb649e-e974-4e15-b9af-e2b3fc1fcfb2'} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-quobyte-deeb649e-e974-4e15-b9af-e2b3fc1fcfb2-1245878f-d1ee-4052-a36d-8f79efa043e1" by "_create_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-deeb649e-e974-4e15-b9af-e2b3fc1fcfb2-1245878f-d1ee-4052-a36d-8f79efa043e1" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Creating volume 1245878f-d1ee-4052-a36d-8f79efa043e1 from snapshot deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 {{(pid=83231) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-quobyte-1245878f-d1ee-4052-a36d-8f79efa043e1" by "_copy_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-1245878f-d1ee-4052-a36d-8f79efa043e1" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] snapshot: deeb649e-e974-4e15-b9af-e2b3fc1fcfb2, volume: 1245878f-d1ee-4052-a36d-8f79efa043e1, {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb3f1d1-d6b2-418f-828f-a1ba04e7fb8b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:59 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 Feb 27 02:08:59 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:00 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:00 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-739ac5a2-f5f5-4197-8b78-e64169579591 tempest-VolumesTransfersV357Test-1833992868 None] Transfer volume completed successfully. Feb 27 02:09:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3" returned: 0 in 0.676s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:00 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3 Feb 27 02:09:00 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:00 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2" returned: 0 in 0.652s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f84976df-6dbe-4ce5-b45c-d7aac9639366(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:09:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Creating direct copy from snapshot {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:09:00 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[021365f3-0ca0-4245-84ad-1f45e2bafc14]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:00 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 Feb 27 02:09:00 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:00 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3" returned: 0 in 0.494s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:00 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Lock "cinder-quobyte-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3" released by "delete_volume" :: held 1.214s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:00 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Created reservations ['f2465f3e-041f-4d2b-9f75-8400aefa955a', '7ff6ca9d-1cb6-4fa0-9997-30fc45f081c8', '7138bbf1-8154-41b0-aff0-5b9d37789e73', '42dcdb80-76c9-4cb2-97a0-20587fd2ee1f'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:00 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:00 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:01 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366" returned: 0 in 0.660s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:01 devstack cinder-volume[83231]: DEBUG cinder.utils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Path /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1245878f-d1ee-4052-a36d-8f79efa043e1 not found in is_blk_device check {{(pid=83231) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:09:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1245878f-d1ee-4052-a36d-8f79efa043e1 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] Acquiring lock "cinder-bb5c91f3-b177-4401-914c-f7a05b0fc78f-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:01 devstack sudo[89300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1245878f-d1ee-4052-a36d-8f79efa043e1 Feb 27 02:09:01 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] Lock "cinder-bb5c91f3-b177-4401-914c-f7a05b0fc78f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] Acquiring lock "cinder-quobyte-bb5c91f3-b177-4401-914c-f7a05b0fc78f" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] Lock "cinder-quobyte-bb5c91f3-b177-4401-914c-f7a05b0fc78f" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:01 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[525dc3b0-4039-4c5a-a496-398fded1888a]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bb5c91f3-b177-4401-914c-f7a05b0fc78f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:01 devstack sudo[89302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bb5c91f3-b177-4401-914c-f7a05b0fc78f Feb 27 02:09:01 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:01 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.545s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:01 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:01 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Deleted volume successfully. Feb 27 02:09:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-98d59c99-db6f-49c8-be40-dcc9a9411ecc tempest-VolumesSnapshotNegativeTestJSON-175795354 None] Lock "cinder-e04c377f-3ca3-488c-8ad9-e9acaedcd0f3-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:01 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bb5c91f3-b177-4401-914c-f7a05b0fc78f" returned: 0 in 0.719s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bb5c91f3-b177-4401-914c-f7a05b0fc78f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:02 devstack sudo[89318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bb5c91f3-b177-4401-914c-f7a05b0fc78f Feb 27 02:09:02 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:03 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-bb5c91f3-b177-4401-914c-f7a05b0fc78f" returned: 0 in 1.185s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] Lock "cinder-quobyte-bb5c91f3-b177-4401-914c-f7a05b0fc78f" released by "delete_volume" :: held 1.948s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] Created reservations ['41ef1513-0450-4714-8035-96f117e45b02', '48408b43-043b-4aa6-8fbd-6766a6774f9b', 'a0ed1aa0-1e8a-4fe8-a865-8774c6720301', '035502bf-b133-49a8-909a-dcc80f3c8af4'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:03 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:03 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:03 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1245878f-d1ee-4052-a36d-8f79efa043e1" returned: 0 in 2.587s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e016e9cd-defe-4d9a-8c2d-48e892741547]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:03 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 Feb 27 02:09:03 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Flow 'volume_create_manager' (5aeb4fe9-ed6e-45bf-92c1-498a8a40cbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10dafdda-127b-4ab6-a471-0d482b6eca5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10dafdda-127b-4ab6-a471-0d482b6eca5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-294301121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210badcc-a831-41c2-9fb2-fa9f7842436d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ea34f2f4014bbe8d40b14a2e10aa96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:04Z,use_quota=True,user_id='e8fd90df456941e98b5131dc49aff6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d01a267-b4a0-47cf-b0be-2c3b830385f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d01a267-b4a0-47cf-b0be-2c3b830385f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a426ca22-a252-4b78-97d8-15751f961701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a426ca22-a252-4b78-97d8-15751f961701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '210badcc-a831-41c2-9fb2-fa9f7842436d', 'volume_name': 'volume-210badcc-a831-41c2-9fb2-fa9f7842436d', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fb848e-eb80-4a1e-b862-6eab75933c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fb848e-eb80-4a1e-b862-6eab75933c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10bd618c-d7b0-4bd4-af1e-6068ff83b4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:04 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Volume 210badcc-a831-41c2-9fb2-fa9f7842436d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-210badcc-a831-41c2-9fb2-fa9f7842436d', 'volume_size': 1} Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:04 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.655s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:04 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] Deleted volume successfully. Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6e78d291-593f-4abe-86c3-1dc92170f15b tempest-VolumesTransfersV357Test-45479577 None] Lock "cinder-bb5c91f3-b177-4401-914c-f7a05b0fc78f-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:04 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366" returned: 0 in 0.727s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Image conversion details: src /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366, size 1024.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1245878f-d1ee-4052-a36d-8f79efa043e1 {{(pid=83231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:09:04 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Converted 1024.00 MB image at 395.61 MB/s Feb 27 02:09:04 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1245878f-d1ee-4052-a36d-8f79efa043e1 is being set with open permissions: ugo+rw Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1245878f-d1ee-4052-a36d-8f79efa043e1 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:04 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1245878f-d1ee-4052-a36d-8f79efa043e1 Feb 27 02:09:04 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:04 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1245878f-d1ee-4052-a36d-8f79efa043e1" returned: 0 in 0.539s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-1245878f-d1ee-4052-a36d-8f79efa043e1" released by "_copy_volume_from_snapshot" :: held 5.253s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-deeb649e-e974-4e15-b9af-e2b3fc1fcfb2-1245878f-d1ee-4052-a36d-8f79efa043e1" released by "_create_volume_from_snapshot" :: held 5.281s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.293s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.943s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-294301121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210badcc-a831-41c2-9fb2-fa9f7842436d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ea34f2f4014bbe8d40b14a2e10aa96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:04Z,use_quota=True,user_id='e8fd90df456941e98b5131dc49aff6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Creating volume 210badcc-a831-41c2-9fb2-fa9f7842436d {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:04 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-210badcc-a831-41c2-9fb2-fa9f7842436d 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:04 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-210badcc-a831-41c2-9fb2-fa9f7842436d 1073741824 Feb 27 02:09:04 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8ae5b7-ee84-4589-b9fe-0602800e22e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1245878f-d1ee-4052-a36d-8f79efa043e1', 'volume_size': 1, 'snapshot_id': 'deeb649e-e974-4e15-b9af-e2b3fc1fcfb2'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b024d5-d984-4ebc-9c01-951c4c50506b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:05 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Volume volume-1245878f-d1ee-4052-a36d-8f79efa043e1 (1245878f-d1ee-4052-a36d-8f79efa043e1): created successfully Feb 27 02:09:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b024d5-d984-4ebc-9c01-951c4c50506b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Flow 'volume_create_manager' (a13697ff-d454-42c3-9ed1-efff1bd2b7c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:05 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-e205867d-3255-44da-a141-ba25e27b48a3 tempest-VolumesSnapshotTestJSON-1701854852 None] Created volume successfully. Feb 27 02:09:05 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Flow 'volume_create_manager' (b736e736-7d38-4996-a4f9-4383a37f5968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4149618f-8f71-4103-b8c7-191e2accdda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4149618f-8f71-4103-b8c7-191e2accdda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-519202705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec2121aa-49af-443c-8aeb-c9bd2874fe06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08db7a4b2314a0b8b97dfd85be89c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:05Z,use_quota=True,user_id='2731ce7c9fb744a9ac8d579b9fa6beb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a221a7ae-2dda-47b7-9417-1f773e7a3015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a221a7ae-2dda-47b7-9417-1f773e7a3015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8257b3c2-b5e5-432d-8dc3-199af17b7103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8257b3c2-b5e5-432d-8dc3-199af17b7103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec2121aa-49af-443c-8aeb-c9bd2874fe06', 'volume_name': 'volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78c22a7-412b-4f7d-9217-a302c49d76e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78c22a7-412b-4f7d-9217-a302c49d76e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f15b5b07-ae9c-49ba-9d78-e32d57131b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:05 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Volume ec2121aa-49af-443c-8aeb-c9bd2874fe06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06', 'volume_size': 1} Feb 27 02:09:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:05 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-210badcc-a831-41c2-9fb2-fa9f7842436d 1073741824" returned: 0 in 0.572s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-210badcc-a831-41c2-9fb2-fa9f7842436d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:05 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-210badcc-a831-41c2-9fb2-fa9f7842436d Feb 27 02:09:05 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:06 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-210badcc-a831-41c2-9fb2-fa9f7842436d" returned: 0 in 0.473s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.773s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-519202705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec2121aa-49af-443c-8aeb-c9bd2874fe06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08db7a4b2314a0b8b97dfd85be89c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:05Z,use_quota=True,user_id='2731ce7c9fb744a9ac8d579b9fa6beb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Creating volume ec2121aa-49af-443c-8aeb-c9bd2874fe06 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:06 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10bd618c-d7b0-4bd4-af1e-6068ff83b4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-210badcc-a831-41c2-9fb2-fa9f7842436d', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc449d5-931d-411a-83dc-964a4f8a1647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:06 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06 1073741824 Feb 27 02:09:06 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-1245878f-d1ee-4052-a36d-8f79efa043e1-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:06 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Volume volume-210badcc-a831-41c2-9fb2-fa9f7842436d (210badcc-a831-41c2-9fb2-fa9f7842436d): created successfully Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc449d5-931d-411a-83dc-964a4f8a1647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Flow 'volume_create_manager' (5aeb4fe9-ed6e-45bf-92c1-498a8a40cbbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:06 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-f2d80d9c-15e7-46ce-93b4-08339f7754e5 tempest-VolumesTransfersV357Test-1038709327 None] Created volume successfully. Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-1245878f-d1ee-4052-a36d-8f79efa043e1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-quobyte-1245878f-d1ee-4052-a36d-8f79efa043e1" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-1245878f-d1ee-4052-a36d-8f79efa043e1" acquired by "delete_volume" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d5755e-33a0-4df5-8389-f9156a07060d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1245878f-d1ee-4052-a36d-8f79efa043e1 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:06 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1245878f-d1ee-4052-a36d-8f79efa043e1 Feb 27 02:09:06 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:06 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06 1073741824" returned: 0 in 0.668s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:06 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1245878f-d1ee-4052-a36d-8f79efa043e1" returned: 0 in 0.579s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1245878f-d1ee-4052-a36d-8f79efa043e1 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:06 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1245878f-d1ee-4052-a36d-8f79efa043e1 Feb 27 02:09:06 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:06 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06 Feb 27 02:09:06 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:07 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06" returned: 0 in 0.538s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f15b5b07-ae9c-49ba-9d78-e32d57131b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43416ad-2a4d-4a1c-9ce3-296391aff666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:07 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1245878f-d1ee-4052-a36d-8f79efa043e1" returned: 0 in 0.594s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-1245878f-d1ee-4052-a36d-8f79efa043e1" released by "delete_volume" :: held 1.206s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:07 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Volume volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06 (ec2121aa-49af-443c-8aeb-c9bd2874fe06): created successfully Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43416ad-2a4d-4a1c-9ce3-296391aff666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Flow 'volume_create_manager' (b736e736-7d38-4996-a4f9-4383a37f5968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] Acquiring lock "cinder-210badcc-a831-41c2-9fb2-fa9f7842436d-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:07 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-9db66a12-01a5-4d87-a958-d70e3d96b6b6 tempest-CreateVolumesFromSnapshotTest-927141897 None] Created volume successfully. Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] Lock "cinder-210badcc-a831-41c2-9fb2-fa9f7842436d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] Acquiring lock "cinder-quobyte-210badcc-a831-41c2-9fb2-fa9f7842436d" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] Lock "cinder-quobyte-210badcc-a831-41c2-9fb2-fa9f7842436d" acquired by "delete_volume" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] Created reservations ['3c37a93e-e192-42d2-8582-6b3007c40b4e', 'aaacd82d-447e-4c43-8069-144183c02ddd', 'ea9156de-90d4-46bb-9cbc-06639e3253d6', 'fa139c78-f78f-4128-94a9-4c782bd03161'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9596a85-8986-434e-a5fc-4ea21b8bc2fe]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-210badcc-a831-41c2-9fb2-fa9f7842436d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:07 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:07 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:07 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-210badcc-a831-41c2-9fb2-fa9f7842436d Feb 27 02:09:07 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:08 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.467s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:08 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] Deleted volume successfully. Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-49a10611-566d-4f2e-98c3-c5686fec389f tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-1245878f-d1ee-4052-a36d-8f79efa043e1-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:08 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-210badcc-a831-41c2-9fb2-fa9f7842436d" returned: 0 in 0.576s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-210badcc-a831-41c2-9fb2-fa9f7842436d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:08 devstack sudo[89367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-210badcc-a831-41c2-9fb2-fa9f7842436d Feb 27 02:09:08 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-deeb649e-e974-4e15-b9af-e2b3fc1fcfb2-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-deeb649e-e974-4e15-b9af-e2b3fc1fcfb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-quobyte-f84976df-6dbe-4ce5-b45c-d7aac9639366" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-f84976df-6dbe-4ce5-b45c-d7aac9639366" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-quobyte-deeb649e-e974-4e15-b9af-e2b3fc1fcfb2" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-deeb649e-e974-4e15-b9af-e2b3fc1fcfb2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] Deleting offline snapshot deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 of volume f84976df-6dbe-4ce5-b45c-d7aac9639366 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] snapshot_file for this snap is: volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ae4a0f-a074-4eba-80c5-c1ccf0e5cdcb]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:08 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 Feb 27 02:09:08 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-65bf56a6-0cdf-4594-873d-85d20c7c73f2 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-65bf56a6-0cdf-4594-873d-85d20c7c73f2 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-65bf56a6-0cdf-4594-873d-85d20c7c73f2 tempest-CreateVolumesFromSnapshotTest-927141897 None] Creating offline snapshot a5e31f28-a1bc-47e3-9a23-de4fb9038628 of volume ec2121aa-49af-443c-8aeb-c9bd2874fe06 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fba793-4e5a-4dcd-a67b-5f7bf636c8cd]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-65bf56a6-0cdf-4594-873d-85d20c7c73f2 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:08 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-210badcc-a831-41c2-9fb2-fa9f7842436d" returned: 0 in 0.551s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] Lock "cinder-quobyte-210badcc-a831-41c2-9fb2-fa9f7842436d" released by "delete_volume" :: held 1.171s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] Created reservations ['d773dbbb-2a64-4d55-b8a8-39c4bb266a8a', 'ed627675-589f-4084-9bbd-d0b57e749a4d', '2eec3d3b-77e4-47f8-a215-2d323f93b712', 'e308854b-8480-4490-bbbe-0703cf050672'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:08 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06 Feb 27 02:09:08 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:08 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:08 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:09 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2" returned: 0 in 0.598s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:09 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f84976df-6dbe-4ce5-b45c-d7aac9639366(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:09 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f79524e-a378-46f6-963e-387b0f74a2db]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:09 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 Feb 27 02:09:09 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:09 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-65bf56a6-0cdf-4594-873d-85d20c7c73f2 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06" returned: 0 in 0.557s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-65bf56a6-0cdf-4594-873d-85d20c7c73f2 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:09 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628 1G Feb 27 02:09:09 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:09 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.507s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:09 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:09 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] Deleted volume successfully. Feb 27 02:09:09 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-53298045-c119-43ea-b63a-705580a624f5 tempest-VolumesTransfersV357Test-45479577 None] Lock "cinder-210badcc-a831-41c2-9fb2-fa9f7842436d-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:09 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366" returned: 0 in 0.536s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:09 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 Feb 27 02:09:09 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:09 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-65bf56a6-0cdf-4594-873d-85d20c7c73f2 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628 1G" returned: 0 in 0.605s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-65bf56a6-0cdf-4594-873d-85d20c7c73f2 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:09 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628 Feb 27 02:09:09 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:10 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2" returned: 0 in 0.562s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:10 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2 Feb 27 02:09:10 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:10 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-65bf56a6-0cdf-4594-873d-85d20c7c73f2 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628" returned: 0 in 0.530s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:10 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-65bf56a6-0cdf-4594-873d-85d20c7c73f2 tempest-CreateVolumesFromSnapshotTest-927141897 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628 is being set with open permissions: ugo+rw Feb 27 02:09:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-65bf56a6-0cdf-4594-873d-85d20c7c73f2 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:10 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628 Feb 27 02:09:10 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:10 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366.deeb649e-e974-4e15-b9af-e2b3fc1fcfb2" returned: 0 in 0.565s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:10 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-deeb649e-e974-4e15-b9af-e2b3fc1fcfb2" released by "_delete_snapshot" :: held 2.326s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:10 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-f84976df-6dbe-4ce5-b45c-d7aac9639366" released by "delete_snapshot" :: held 2.347s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:10 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] Created reservations ['3f895bfe-2ac6-4275-a23b-7f3681985a01', 'c34d7b95-afb2-42af-b99c-7c85a00fdb00', 'cbfccd42-912b-406b-9d02-87f593708990', '58017798-7200-4f8a-a82d-a7d6300bbe41'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:10 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] Delete snapshot completed successfully. Feb 27 02:09:10 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-21c763f5-1161-496d-9bf2-c30cda80deda tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-deeb649e-e974-4e15-b9af-e2b3fc1fcfb2-delete_snapshot" released by "delete_snapshot" :: held 2.475s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:10 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-65bf56a6-0cdf-4594-873d-85d20c7c73f2 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628" returned: 0 in 0.548s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-65bf56a6-0cdf-4594-873d-85d20c7c73f2 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:10 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.info Feb 27 02:09:10 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:11 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-65bf56a6-0cdf-4594-873d-85d20c7c73f2 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.info" returned: 0 in 0.507s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:11 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-65bf56a6-0cdf-4594-873d-85d20c7c73f2 tempest-CreateVolumesFromSnapshotTest-927141897 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.info is being set with open permissions: ugo+rw Feb 27 02:09:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-65bf56a6-0cdf-4594-873d-85d20c7c73f2 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:11 devstack sudo[89412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.info Feb 27 02:09:11 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:11 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-f84976df-6dbe-4ce5-b45c-d7aac9639366-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:11 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-f84976df-6dbe-4ce5-b45c-d7aac9639366-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:11 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-quobyte-f84976df-6dbe-4ce5-b45c-d7aac9639366" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:11 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-f84976df-6dbe-4ce5-b45c-d7aac9639366" acquired by "delete_volume" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:11 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f606c287-5934-4612-8f9a-301eea0dfbbf]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:11 devstack sudo[89414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 Feb 27 02:09:11 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:11 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-65bf56a6-0cdf-4594-873d-85d20c7c73f2 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.info" returned: 0 in 0.514s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-65bf56a6-0cdf-4594-873d-85d20c7c73f2 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.327s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:11 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-65bf56a6-0cdf-4594-873d-85d20c7c73f2 tempest-CreateVolumesFromSnapshotTest-927141897 None] Create snapshot completed successfully Feb 27 02:09:12 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366" returned: 0 in 0.549s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:12 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366 Feb 27 02:09:12 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:12 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f84976df-6dbe-4ce5-b45c-d7aac9639366" returned: 0 in 0.439s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:12 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-f84976df-6dbe-4ce5-b45c-d7aac9639366" released by "delete_volume" :: held 1.027s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:12 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] Created reservations ['d31346ad-77a9-42f9-a828-e6080602dcc9', '758916fb-6fe4-45ff-9941-8a635cb728a4', 'd406c648-8864-454e-a064-2ac01f4a425c', 'd86deb2f-e415-4254-a67f-482859e815ba'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:12 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:12 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:12 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Flow 'volume_create_manager' (d07e2909-7d84-4ef6-a152-896f7e43374b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e9019f-39b0-4a95-a785-53ce333f4457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e9019f-39b0-4a95-a785-53ce333f4457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-793140592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859d0087-64ed-4173-864f-966785d0fddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08db7a4b2314a0b8b97dfd85be89c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:13Z,use_quota=True,user_id='2731ce7c9fb744a9ac8d579b9fa6beb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299e48d5-4f6b-4f70-8b5e-960d802bc60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299e48d5-4f6b-4f70-8b5e-960d802bc60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d632672-ba50-481c-9f83-3ce770e76125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d632672-ba50-481c-9f83-3ce770e76125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '859d0087-64ed-4173-864f-966785d0fddd', 'volume_name': 'volume-859d0087-64ed-4173-864f-966785d0fddd', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba09951-3e30-4727-b9bf-dafe0b893417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba09951-3e30-4727-b9bf-dafe0b893417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3f69fb-cb82-4875-b1a7-866ceda5023d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Volume 859d0087-64ed-4173-864f-966785d0fddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-859d0087-64ed-4173-864f-966785d0fddd', 'volume_size': 1} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-793140592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859d0087-64ed-4173-864f-966785d0fddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08db7a4b2314a0b8b97dfd85be89c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:13Z,use_quota=True,user_id='2731ce7c9fb744a9ac8d579b9fa6beb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Creating volume 859d0087-64ed-4173-864f-966785d0fddd {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:13 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-859d0087-64ed-4173-864f-966785d0fddd 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:13 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-859d0087-64ed-4173-864f-966785d0fddd 1073741824 Feb 27 02:09:13 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Flow 'volume_create_manager' (b288d881-6d8d-49c1-ae0f-854322367d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc296dfe-bf32-4e75-9a6e-d8aeb3d67dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc296dfe-bf32-4e75-9a6e-d8aeb3d67dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1911144919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4f0841-9588-45a9-9ec6-c5264274340b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08db7a4b2314a0b8b97dfd85be89c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:13Z,use_quota=True,user_id='2731ce7c9fb744a9ac8d579b9fa6beb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0735c8bd-d145-4492-bd40-04ff7621bb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0735c8bd-d145-4492-bd40-04ff7621bb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011a176c-7e99-4386-a3c4-1b66578727cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011a176c-7e99-4386-a3c4-1b66578727cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e4f0841-9588-45a9-9ec6-c5264274340b', 'volume_name': 'volume-3e4f0841-9588-45a9-9ec6-c5264274340b', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca013cd1-99d2-45b5-87e0-eecef005f635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca013cd1-99d2-45b5-87e0-eecef005f635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643766da-0cf1-43f5-a269-947942531d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Volume 3e4f0841-9588-45a9-9ec6-c5264274340b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e4f0841-9588-45a9-9ec6-c5264274340b', 'volume_size': 1} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.551s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:13 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] Deleted volume successfully. Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1cbe3314-174d-4200-a38d-475068917a8f tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-f84976df-6dbe-4ce5-b45c-d7aac9639366-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Flow 'volume_create_manager' (af630825-d4fd-4bc5-b725-d0ef80c5a37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762378da-5c91-48cc-a85c-d677cf49d013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762378da-5c91-48cc-a85c-d677cf49d013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-899872805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d87992b-b767-476d-a4f4-87e721822dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08db7a4b2314a0b8b97dfd85be89c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:14Z,use_quota=True,user_id='2731ce7c9fb744a9ac8d579b9fa6beb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8675e6ec-db28-4357-8f3f-37e089510d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8675e6ec-db28-4357-8f3f-37e089510d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ead6e12-fcb6-4942-acdb-028b39ad7450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ead6e12-fcb6-4942-acdb-028b39ad7450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d87992b-b767-476d-a4f4-87e721822dbd', 'volume_name': 'volume-1d87992b-b767-476d-a4f4-87e721822dbd', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4928f6-5121-4c3e-bf59-9db8da2db741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4928f6-5121-4c3e-bf59-9db8da2db741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d55f1c-307c-48e7-bd3c-cae281ce850f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Volume 1d87992b-b767-476d-a4f4-87e721822dbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d87992b-b767-476d-a4f4-87e721822dbd', 'volume_size': 1} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Flow 'volume_create_manager' (6bf69c11-826f-4df8-82d4-18236cf3fd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000ab66e-efed-47e5-b818-e9de28f5d37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000ab66e-efed-47e5-b818-e9de28f5d37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1048104246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=672d9922-e84b-4659-a5b0-b514cf6881c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08db7a4b2314a0b8b97dfd85be89c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:14Z,use_quota=True,user_id='2731ce7c9fb744a9ac8d579b9fa6beb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80999b2-cf9d-4a4d-80e8-3c38c9e549b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80999b2-cf9d-4a4d-80e8-3c38c9e549b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775ed1f5-d98a-44ad-bd0b-ee5602fe2588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775ed1f5-d98a-44ad-bd0b-ee5602fe2588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '672d9922-e84b-4659-a5b0-b514cf6881c6', 'volume_name': 'volume-672d9922-e84b-4659-a5b0-b514cf6881c6', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1eefcd3-d3e9-49dd-9346-e8486363c41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1eefcd3-d3e9-49dd-9346-e8486363c41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f83e242-d825-42ec-b874-c7d202e382e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Volume 672d9922-e84b-4659-a5b0-b514cf6881c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-672d9922-e84b-4659-a5b0-b514cf6881c6', 'volume_size': 1} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-859d0087-64ed-4173-864f-966785d0fddd 1073741824" returned: 0 in 0.778s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-859d0087-64ed-4173-864f-966785d0fddd {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:13 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-859d0087-64ed-4173-864f-966785d0fddd Feb 27 02:09:13 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Flow 'volume_create_manager' (1de64757-1f7b-4ba1-9229-1e1134a95005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf4feff-22f9-4b7f-ae18-67c266021674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-f79af4ba-d622-4066-bfdc-d8cbcf77174a-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf4feff-22f9-4b7f-ae18-67c266021674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1879310967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9775e088-d5de-4b2f-8d90-04755d959a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ca9bf8fb864cff9b4d6061c15c9a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:14Z,use_quota=True,user_id='d95a249947bf44c6a66407210c661b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9d8871-9ad4-4303-821a-4b2dff6f84aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9d8871-9ad4-4303-821a-4b2dff6f84aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e0a449-620b-496d-bb93-b1eec49401b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.image.glance [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Creating Keystone auth plugin from conf {{(pid=83231) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-f79af4ba-d622-4066-bfdc-d8cbcf77174a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Flow 'volume_create_manager' (a9110b57-7deb-4780-8931-d183572e008f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05cca86-94a4-4d5c-8617-59dd1f1c2b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05cca86-94a4-4d5c-8617-59dd1f1c2b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-185515351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08db7a4b2314a0b8b97dfd85be89c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:14Z,use_quota=True,user_id='2731ce7c9fb744a9ac8d579b9fa6beb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4805580-a29d-47f5-b36c-8da78ebe02f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4805580-a29d-47f5-b36c-8da78ebe02f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f132550a-0001-4a0e-afeb-256a22f63d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f132550a-0001-4a0e-afeb-256a22f63d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3', 'volume_name': 'volume-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c4475e-80ef-4dd8-b3ea-029f7a99b8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c4475e-80ef-4dd8-b3ea-029f7a99b8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1477a7ea-a78d-4ab3-8d47-ce60658f563c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Volume 96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3', 'volume_size': 1} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "cinder-quobyte-f79af4ba-d622-4066-bfdc-d8cbcf77174a" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-f79af4ba-d622-4066-bfdc-d8cbcf77174a" acquired by "delete_volume" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8935c5d6-e04f-4ca6-8607-baeef3981e5f]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:14 devstack sudo[89441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a Feb 27 02:09:14 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e0a449-620b-496d-bb93-b1eec49401b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9775e088-d5de-4b2f-8d90-04755d959a29', 'volume_name': 'volume-9775e088-d5de-4b2f-8d90-04755d959a29', 'volume_size': 1, 'image_id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '264ceeea24524ec49624b8e3d37f06d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f8801b-3b47-4c03-a79b-d2330d97e202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f8801b-3b47-4c03-a79b-d2330d97e202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (535f870a-9397-452d-b656-4ad1a6a9b615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Volume 9775e088-d5de-4b2f-8d90-04755d959a29: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9775e088-d5de-4b2f-8d90-04755d959a29', 'volume_size': 1, 'image_id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '264ceeea24524ec49624b8e3d37f06d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Trying to clone 9775e088-d5de-4b2f-8d90-04755d959a29 from image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}]). {{(pid=83231) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:09:14 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-859d0087-64ed-4173-864f-966785d0fddd" returned: 0 in 0.520s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.064s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1911144919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4f0841-9588-45a9-9ec6-c5264274340b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08db7a4b2314a0b8b97dfd85be89c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:13Z,use_quota=True,user_id='2731ce7c9fb744a9ac8d579b9fa6beb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Creating volume 3e4f0841-9588-45a9-9ec6-c5264274340b {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:14 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3e4f0841-9588-45a9-9ec6-c5264274340b 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3f69fb-cb82-4875-b1a7-866ceda5023d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-859d0087-64ed-4173-864f-966785d0fddd', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3e4f0841-9588-45a9-9ec6-c5264274340b 1073741824 Feb 27 02:09:14 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8ad0b6-a311-4a68-bae5-c39f7b4fefa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Volume volume-859d0087-64ed-4173-864f-966785d0fddd (859d0087-64ed-4173-864f-966785d0fddd): created successfully Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8ad0b6-a311-4a68-bae5-c39f7b4fefa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Flow 'volume_create_manager' (d07e2909-7d84-4ef6-a152-896f7e43374b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:14 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-0c915eea-a274-48e9-a5a4-00e21b2f4655 tempest-CreateVolumesFromSnapshotTest-927141897 None] Created volume successfully. Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_utkkxcr4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83231) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:09:14 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[86817be6-99dd-4767-ba87-94ded2911d2f]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_utkkxcr4devstack@QuobyteHD {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:14 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_utkkxcr4devstack@QuobyteHD Feb 27 02:09:14 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:14 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a" returned: 0 in 0.538s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:14 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a Feb 27 02:09:14 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:14 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3e4f0841-9588-45a9-9ec6-c5264274340b 1073741824" returned: 0 in 0.496s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3e4f0841-9588-45a9-9ec6-c5264274340b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:14 devstack sudo[89457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3e4f0841-9588-45a9-9ec6-c5264274340b Feb 27 02:09:14 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:15 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_utkkxcr4devstack@QuobyteHD" returned: 0 in 0.584s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Temporary image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 is fetched for user d95a249947bf44c6a66407210c661b8e. {{(pid=83231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[374e31cf-bbe4-4595-934f-df201aa8d66a]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_utkkxcr4devstack@QuobyteHD {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:15 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79af4ba-d622-4066-bfdc-d8cbcf77174a" returned: 0 in 0.501s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-quobyte-f79af4ba-d622-4066-bfdc-d8cbcf77174a" released by "delete_volume" :: held 1.071s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] Created reservations ['47e587f0-1252-460f-8278-3401c142fbf2', '9ad6d13e-0cfe-44e6-b793-b66ac4c46866', '005778c8-6a81-482c-bc31-125ecb9140a1', 'fcfaa9af-19b5-41e3-90c3-dee25ae073f8'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:15 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_utkkxcr4devstack@QuobyteHD Feb 27 02:09:15 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:15 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:15 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:15 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3e4f0841-9588-45a9-9ec6-c5264274340b" returned: 0 in 0.577s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.893s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-899872805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d87992b-b767-476d-a4f4-87e721822dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08db7a4b2314a0b8b97dfd85be89c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:14Z,use_quota=True,user_id='2731ce7c9fb744a9ac8d579b9fa6beb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Creating volume 1d87992b-b767-476d-a4f4-87e721822dbd {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:15 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1d87992b-b767-476d-a4f4-87e721822dbd 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643766da-0cf1-43f5-a269-947942531d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e4f0841-9588-45a9-9ec6-c5264274340b', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c443dcdf-e5b1-4392-8707-6166e29ee2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:15 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1d87992b-b767-476d-a4f4-87e721822dbd 1073741824 Feb 27 02:09:15 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:15 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Volume volume-3e4f0841-9588-45a9-9ec6-c5264274340b (3e4f0841-9588-45a9-9ec6-c5264274340b): created successfully Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c443dcdf-e5b1-4392-8707-6166e29ee2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Flow 'volume_create_manager' (b288d881-6d8d-49c1-ae0f-854322367d4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:15 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-95eeff53-4355-49f7-9990-eb8a2222eda7 tempest-CreateVolumesFromSnapshotTest-927141897 None] Created volume successfully. Feb 27 02:09:15 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_utkkxcr4devstack@QuobyteHD" returned: 0 in 0.572s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:15 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.435s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:15 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] Deleted volume successfully. Feb 27 02:09:15 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d62f5214-b2ea-418c-a7ad-9056de5665bc tempest-VolumesSnapshotTestJSON-1701854852 None] Lock "cinder-f79af4ba-d622-4066-bfdc-d8cbcf77174a-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:16 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1d87992b-b767-476d-a4f4-87e721822dbd 1073741824" returned: 0 in 0.552s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1d87992b-b767-476d-a4f4-87e721822dbd {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:16 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1d87992b-b767-476d-a4f4-87e721822dbd Feb 27 02:09:16 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:16 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1d87992b-b767-476d-a4f4-87e721822dbd" returned: 0 in 0.455s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.699s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1048104246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=672d9922-e84b-4659-a5b0-b514cf6881c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08db7a4b2314a0b8b97dfd85be89c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:14Z,use_quota=True,user_id='2731ce7c9fb744a9ac8d579b9fa6beb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Creating volume 672d9922-e84b-4659-a5b0-b514cf6881c6 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:16 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:09:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-672d9922-e84b-4659-a5b0-b514cf6881c6 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:16 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-672d9922-e84b-4659-a5b0-b514cf6881c6 1073741824 Feb 27 02:09:16 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d55f1c-307c-48e7-bd3c-cae281ce850f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d87992b-b767-476d-a4f4-87e721822dbd', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5d312f-d042-45da-9f55-0b5c0ea31019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:16 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Volume volume-1d87992b-b767-476d-a4f4-87e721822dbd (1d87992b-b767-476d-a4f4-87e721822dbd): created successfully Feb 27 02:09:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5d312f-d042-45da-9f55-0b5c0ea31019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Flow 'volume_create_manager' (af630825-d4fd-4bc5-b725-d0ef80c5a37b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:16 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-6f5e26bf-1f7e-4cff-9b17-8d91888ba309 tempest-CreateVolumesFromSnapshotTest-927141897 None] Created volume successfully. Feb 27 02:09:17 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-672d9922-e84b-4659-a5b0-b514cf6881c6 1073741824" returned: 0 in 0.618s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-672d9922-e84b-4659-a5b0-b514cf6881c6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:17 devstack sudo[89485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-672d9922-e84b-4659-a5b0-b514cf6881c6 Feb 27 02:09:17 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:17 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-672d9922-e84b-4659-a5b0-b514cf6881c6" returned: 0 in 0.481s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:17 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.505s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:17 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-185515351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08db7a4b2314a0b8b97dfd85be89c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:14Z,use_quota=True,user_id='2731ce7c9fb744a9ac8d579b9fa6beb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:17 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Creating volume 96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:17 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:17 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:17 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:17 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:09:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:17 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f83e242-d825-42ec-b874-c7d202e382e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-672d9922-e84b-4659-a5b0-b514cf6881c6', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:17 devstack sudo[89489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3 1073741824 Feb 27 02:09:17 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbed37a6-93b2-4640-a46a-485504c5017c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:17 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:17 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Volume volume-672d9922-e84b-4659-a5b0-b514cf6881c6 (672d9922-e84b-4659-a5b0-b514cf6881c6): created successfully Feb 27 02:09:17 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbed37a6-93b2-4640-a46a-485504c5017c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:17 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Flow 'volume_create_manager' (6bf69c11-826f-4df8-82d4-18236cf3fd8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:17 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-243f2daa-dccf-4b6f-b54d-5c01cc3121cc tempest-CreateVolumesFromSnapshotTest-927141897 None] Created volume successfully. Feb 27 02:09:18 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3 1073741824" returned: 0 in 0.681s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:18 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3 Feb 27 02:09:18 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:18 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3" returned: 0 in 0.572s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.183s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1879310967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9775e088-d5de-4b2f-8d90-04755d959a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ca9bf8fb864cff9b4d6061c15c9a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:14Z,use_quota=True,user_id='d95a249947bf44c6a66407210c661b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Creating volume 9775e088-d5de-4b2f-8d90-04755d959a29 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:19 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:09:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1477a7ea-a78d-4ab3-8d47-ce60658f563c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:19 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 1073741824 Feb 27 02:09:19 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6907a81-2ab1-4407-986e-00cc8c970a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:19 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Volume volume-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3 (96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3): created successfully Feb 27 02:09:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6907a81-2ab1-4407-986e-00cc8c970a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:19 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Flow 'volume_create_manager' (a9110b57-7deb-4780-8931-d183572e008f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:19 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-ca37af35-1568-4d97-9da0-eea12b4a7959 tempest-CreateVolumesFromSnapshotTest-927141897 None] Created volume successfully. Feb 27 02:09:19 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 1073741824" returned: 0 in 0.642s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:19 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "cinder-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:19 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:19 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 Feb 27 02:09:19 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:19 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "cinder-quobyte-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:19 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-quobyte-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:19 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3632477e-b26a-4982-9a4f-85e8cfe729f9]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:19 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3 Feb 27 02:09:19 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:20 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29" returned: 0 in 0.503s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:20 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:20 devstack cinder-volume[83231]: DEBUG cinder.volume.volume_utils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Attempting download of e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}])) to volume 9775e088-d5de-4b2f-8d90-04755d959a29. {{(pid=83231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:09:20 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[da71c60e-d1a2-4b96-9aa1-fbf83db5ff79]: (4, 'raw') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_7wy1sibl {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:20 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_7wy1sibl Feb 27 02:09:20 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:20 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3" returned: 0 in 0.725s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:20 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3 Feb 27 02:09:20 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:20 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_7wy1sibl" returned: 0 in 0.578s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_7wy1sibl {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:20 devstack sudo[89549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_7wy1sibl Feb 27 02:09:20 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:20 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3" returned: 0 in 0.493s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:20 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-quobyte-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3" released by "delete_volume" :: held 1.245s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] Created reservations ['86be2979-713b-4143-93bc-a75e1012031f', '88e58741-e404-4a2f-8e70-e2c5302cce2b', '352f3b36-1f42-4982-a897-57f9122476ee', '8ea55bdc-0524-4198-8d74-16eb20d11244'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:21 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:21 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:21 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_7wy1sibl" returned: 1 in 0.489s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_7wy1sibl' failed. Not Retrying. {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f46451-a868-48c3-bd9f-f474ae25bd1f]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_utkkxcr4devstack@QuobyteHD {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:21 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_utkkxcr4devstack@QuobyteHD Feb 27 02:09:21 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:21 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.457s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:21 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] Deleted volume successfully. Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3d9d4372-2a01-4ff1-8bc9-a1ddfcd63d41 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-96f0dc7b-c2c7-4da2-b0f2-b667627bf0c3-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:21 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_utkkxcr4devstack@QuobyteHD" returned: 0 in 0.528s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 was qcow2, converting to raw {{(pid=83231) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_utkkxcr4devstack@QuobyteHD /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:21 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_utkkxcr4devstack@QuobyteHD /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 Feb 27 02:09:21 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "cinder-672d9922-e84b-4659-a5b0-b514cf6881c6-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-672d9922-e84b-4659-a5b0-b514cf6881c6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "cinder-quobyte-672d9922-e84b-4659-a5b0-b514cf6881c6" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-quobyte-672d9922-e84b-4659-a5b0-b514cf6881c6" acquired by "delete_volume" :: waited 0.020s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e846c5be-f147-4213-828b-1fe1785b5e06]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-672d9922-e84b-4659-a5b0-b514cf6881c6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:22 devstack sudo[89566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-672d9922-e84b-4659-a5b0-b514cf6881c6 Feb 27 02:09:22 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:22 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-672d9922-e84b-4659-a5b0-b514cf6881c6" returned: 0 in 0.529s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-672d9922-e84b-4659-a5b0-b514cf6881c6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:22 devstack sudo[89584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-672d9922-e84b-4659-a5b0-b514cf6881c6 Feb 27 02:09:22 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:22 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_utkkxcr4devstack@QuobyteHD /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29" returned: 0 in 0.934s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:22 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_utkkxcr4devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 {{(pid=83231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:09:22 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Converted 112.00 MB image at 112.00 MB/s Feb 27 02:09:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:22 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 1G Feb 27 02:09:22 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:22 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-672d9922-e84b-4659-a5b0-b514cf6881c6" returned: 0 in 0.456s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-quobyte-672d9922-e84b-4659-a5b0-b514cf6881c6" released by "delete_volume" :: held 1.008s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:23 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] Created reservations ['a0904859-ca10-4a10-bd39-f214070cdeff', '240fbba8-e580-47cd-82c2-51f85a7d7fad', '464a0224-4f6f-4301-b459-5568bffcc1a4', '1f90ee58-56c7-444c-acb4-515db4c2404d'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:23 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:23 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:23 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 1G" returned: 0 in 0.470s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:23 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4661ca3a-795c-4f86-8697-8dff0483e0ec]: (4, 'raw') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:23 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 Feb 27 02:09:23 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:23 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.458s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:23 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:23 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] Deleted volume successfully. Feb 27 02:09:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-07967c72-1e9b-466c-9e4c-b8c826703f19 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-672d9922-e84b-4659-a5b0-b514cf6881c6-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:23 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29" returned: 0 in 0.462s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:23 devstack sudo[89600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 Feb 27 02:09:23 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "cinder-1d87992b-b767-476d-a4f4-87e721822dbd-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-1d87992b-b767-476d-a4f4-87e721822dbd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "cinder-quobyte-1d87992b-b767-476d-a4f4-87e721822dbd" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-quobyte-1d87992b-b767-476d-a4f4-87e721822dbd" acquired by "delete_volume" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[749b89a2-1269-4ad9-9167-e666896018d2]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1d87992b-b767-476d-a4f4-87e721822dbd {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:24 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1d87992b-b767-476d-a4f4-87e721822dbd Feb 27 02:09:24 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:24 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29" returned: 1 in 0.514s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29' failed. Not Retrying. {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG cinder.volume.volume_utils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Downloaded image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}])) to volume 9775e088-d5de-4b2f-8d90-04755d959a29 successfully. {{(pid=83231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Temporary image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 for user d95a249947bf44c6a66407210c661b8e is deleted. {{(pid=83231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG cinder.volume.volume_utils [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Marking volume 9775e088-d5de-4b2f-8d90-04755d959a29 as bootable. {{(pid=83231) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Copying metadata from image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 to 9775e088-d5de-4b2f-8d90-04755d959a29. {{(pid=83231) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Creating volume glance metadata for volume 9775e088-d5de-4b2f-8d90-04755d959a29 backed by image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83231) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (535f870a-9397-452d-b656-4ad1a6a9b615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9775e088-d5de-4b2f-8d90-04755d959a29', 'volume_size': 1, 'image_id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '264ceeea24524ec49624b8e3d37f06d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34837734-af54-4bc0-a0d0-44145979974f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:24 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Volume volume-9775e088-d5de-4b2f-8d90-04755d959a29 (9775e088-d5de-4b2f-8d90-04755d959a29): created successfully Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34837734-af54-4bc0-a0d0-44145979974f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Flow 'volume_create_manager' (1de64757-1f7b-4ba1-9229-1e1134a95005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:24 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-0871cda2-137a-4ff7-849e-816c9931fa3b tempest-VolumesExtendTest-779188539 None] Created volume successfully. Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d384fecb-6f7c-4dda-bc67-c853c42578b8 tempest-VolumesExtendTest-779188539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d384fecb-6f7c-4dda-bc67-c853c42578b8 tempest-VolumesExtendTest-779188539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:24 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1d87992b-b767-476d-a4f4-87e721822dbd" returned: 0 in 0.530s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1d87992b-b767-476d-a4f4-87e721822dbd {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1888b5f-d07b-4c96-b163-947fa966e696]: (4, 'raw') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d384fecb-6f7c-4dda-bc67-c853c42578b8 tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:24 devstack sudo[89610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1d87992b-b767-476d-a4f4-87e721822dbd Feb 27 02:09:24 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:24 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 Feb 27 02:09:24 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:25 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-1d87992b-b767-476d-a4f4-87e721822dbd" returned: 0 in 0.461s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:25 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-quobyte-1d87992b-b767-476d-a4f4-87e721822dbd" released by "delete_volume" :: held 1.025s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:25 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d384fecb-6f7c-4dda-bc67-c853c42578b8 tempest-VolumesExtendTest-779188539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29" returned: 0 in 0.507s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d384fecb-6f7c-4dda-bc67-c853c42578b8 tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:25 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] Created reservations ['55911a97-e768-4167-89d0-705833be0e01', '659a7f33-d027-407b-b182-e4676924da7c', 'd79c3012-50d0-4ec4-a5c9-ea5502fc2027', 'e106a33a-ac0a-49d0-a4ee-3ce209d4d66f'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:25 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:25 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 Feb 27 02:09:25 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:25 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:25 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:25 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:25 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d384fecb-6f7c-4dda-bc67-c853c42578b8 tempest-VolumesExtendTest-779188539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29" returned: 1 in 0.484s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d384fecb-6f7c-4dda-bc67-c853c42578b8 tempest-VolumesExtendTest-779188539 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29' failed. Not Retrying. {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:09:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d384fecb-6f7c-4dda-bc67-c853c42578b8 tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 2G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:25 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d384fecb-6f7c-4dda-bc67-c853c42578b8 tempest-VolumesExtendTest-779188539 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 2G" returned: 0 in 0.046s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d384fecb-6f7c-4dda-bc67-c853c42578b8 tempest-VolumesExtendTest-779188539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.074s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.451s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:25 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:25 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] Deleted volume successfully. Feb 27 02:09:25 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d50e7eea-5cb5-4073-926c-3ef35abba787 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-1d87992b-b767-476d-a4f4-87e721822dbd-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:25 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-d384fecb-6f7c-4dda-bc67-c853c42578b8 tempest-VolumesExtendTest-779188539 None] Extend volume completed successfully. Feb 27 02:09:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "cinder-3e4f0841-9588-45a9-9ec6-c5264274340b-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-3e4f0841-9588-45a9-9ec6-c5264274340b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "cinder-quobyte-3e4f0841-9588-45a9-9ec6-c5264274340b" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-quobyte-3e4f0841-9588-45a9-9ec6-c5264274340b" acquired by "delete_volume" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:26 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d86e8d6-3d6e-46d2-a0b7-c0c968555693]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3e4f0841-9588-45a9-9ec6-c5264274340b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:26 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3e4f0841-9588-45a9-9ec6-c5264274340b Feb 27 02:09:26 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:26 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3e4f0841-9588-45a9-9ec6-c5264274340b" returned: 0 in 0.524s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3e4f0841-9588-45a9-9ec6-c5264274340b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:26 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3e4f0841-9588-45a9-9ec6-c5264274340b Feb 27 02:09:26 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] Acquiring lock "cinder-9775e088-d5de-4b2f-8d90-04755d959a29-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] Lock "cinder-9775e088-d5de-4b2f-8d90-04755d959a29-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] Acquiring lock "cinder-quobyte-9775e088-d5de-4b2f-8d90-04755d959a29" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] Lock "cinder-quobyte-9775e088-d5de-4b2f-8d90-04755d959a29" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ac1d9c-2294-4ec7-ad82-e6ec1c5efa34]: (4, 'raw') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:27 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 Feb 27 02:09:27 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:27 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3e4f0841-9588-45a9-9ec6-c5264274340b" returned: 0 in 0.460s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-quobyte-3e4f0841-9588-45a9-9ec6-c5264274340b" released by "delete_volume" :: held 1.011s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] Created reservations ['233f4935-059f-4641-83d0-fcf1e5ddcf34', 'cb4f1c52-4a83-44e1-854c-7b940441bfc0', 'e54b5529-98c1-49ca-8cc0-094509a75866', '2da898e4-faf2-449b-9685-d7bfb1d191e2'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:27 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:27 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:27 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29" returned: 0 in 0.555s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:27 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 Feb 27 02:09:27 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:27 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.429s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:27 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] Deleted volume successfully. Feb 27 02:09:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-30d35d1b-638f-493f-9163-a5fdee9e389e tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-3e4f0841-9588-45a9-9ec6-c5264274340b-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:28 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29" returned: 1 in 0.503s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29' failed. Not Retrying. {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:09:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:28 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29 Feb 27 02:09:28 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "cinder-859d0087-64ed-4173-864f-966785d0fddd-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-859d0087-64ed-4173-864f-966785d0fddd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "cinder-quobyte-859d0087-64ed-4173-864f-966785d0fddd" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-quobyte-859d0087-64ed-4173-864f-966785d0fddd" acquired by "delete_volume" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:28 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bfc158-15d3-4d76-b3c8-2cea675261a4]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-859d0087-64ed-4173-864f-966785d0fddd {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:28 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9775e088-d5de-4b2f-8d90-04755d959a29" returned: 0 in 0.412s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] Lock "cinder-quobyte-9775e088-d5de-4b2f-8d90-04755d959a29" released by "delete_volume" :: held 1.519s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:28 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-859d0087-64ed-4173-864f-966785d0fddd Feb 27 02:09:28 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:28 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] Created reservations ['ca11b48e-6037-4d83-911f-2fd0e861bcfd', '12deb6b1-f395-4209-8b40-b7300d5e8216', 'e2e81058-35ec-4afe-9e98-b73a535ca9bd', '60184e5f-36de-4aa1-8524-5fc672ab47b8'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:28 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:28 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:28 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:28 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:29 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-859d0087-64ed-4173-864f-966785d0fddd" returned: 0 in 0.484s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-859d0087-64ed-4173-864f-966785d0fddd {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:29 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-859d0087-64ed-4173-864f-966785d0fddd Feb 27 02:09:29 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:29 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.440s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:29 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] Deleted volume successfully. Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6a0b94cc-a95a-46f7-af98-3a5e53dff008 tempest-VolumesExtendTest-779188539 None] Lock "cinder-9775e088-d5de-4b2f-8d90-04755d959a29-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Flow 'volume_create_manager' (49fff085-f020-47bd-86b8-700ac6aa7760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c103dc2-51e8-4992-b685-a1d4d3bcc8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c103dc2-51e8-4992-b685-a1d4d3bcc8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1653453999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11bbf4dc-3a60-4fc7-a8ce-9c491e85974c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ca9bf8fb864cff9b4d6061c15c9a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:29Z,use_quota=True,user_id='d95a249947bf44c6a66407210c661b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b137c180-d37c-496f-8de8-070f948b2f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b137c180-d37c-496f-8de8-070f948b2f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea3ecf8-98e0-4bcc-be08-48c5ffd44207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea3ecf8-98e0-4bcc-be08-48c5ffd44207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11bbf4dc-3a60-4fc7-a8ce-9c491e85974c', 'volume_name': 'volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c49faf-ddbb-4572-9e46-e4f2f145577d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c49faf-ddbb-4572-9e46-e4f2f145577d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280d2ff0-87df-42a5-8a6f-20fe8ff3e9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:29 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:29 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Volume 11bbf4dc-3a60-4fc7-a8ce-9c491e85974c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c', 'volume_size': 1} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1653453999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11bbf4dc-3a60-4fc7-a8ce-9c491e85974c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ca9bf8fb864cff9b4d6061c15c9a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:29Z,use_quota=True,user_id='d95a249947bf44c6a66407210c661b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Creating volume 11bbf4dc-3a60-4fc7-a8ce-9c491e85974c {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:29 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-859d0087-64ed-4173-864f-966785d0fddd" returned: 0 in 0.509s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-quobyte-859d0087-64ed-4173-864f-966785d0fddd" released by "delete_volume" :: held 1.016s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:29 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c 1073741824 Feb 27 02:09:29 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] Created reservations ['0660e29d-d197-4c74-ad46-ea2c13b6d96d', 'ee8cf3eb-d78d-42ff-9b1e-660d25c14131', '651417fd-3e39-4f21-94a8-4d6c5639e644', 'c1301023-3c93-4293-bb26-ac9cac8b86cd'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:29 devstack sudo[89664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:29 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:30 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c 1073741824" returned: 0 in 0.496s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:30 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c Feb 27 02:09:30 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:30 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.441s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:30 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] Deleted volume successfully. Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c45ee60b-8c15-4fc4-b2fd-621d7fafd140 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-859d0087-64ed-4173-864f-966785d0fddd-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:30 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c" returned: 0 in 0.404s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280d2ff0-87df-42a5-8a6f-20fe8ff3e9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c159c73-613f-43eb-9824-a41eb94c3846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:30 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Volume volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c (11bbf4dc-3a60-4fc7-a8ce-9c491e85974c): created successfully Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c159c73-613f-43eb-9824-a41eb94c3846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Flow 'volume_create_manager' (49fff085-f020-47bd-86b8-700ac6aa7760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:30 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b3275c42-4dc3-4e96-ac75-7ad809011ac2 tempest-VolumesExtendTest-779188539 None] Created volume successfully. Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "cinder-a5e31f28-a1bc-47e3-9a23-de4fb9038628-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-a5e31f28-a1bc-47e3-9a23-de4fb9038628-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "cinder-quobyte-ec2121aa-49af-443c-8aeb-c9bd2874fe06" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-quobyte-ec2121aa-49af-443c-8aeb-c9bd2874fe06" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "cinder-quobyte-a5e31f28-a1bc-47e3-9a23-de4fb9038628" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-quobyte-a5e31f28-a1bc-47e3-9a23-de4fb9038628" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] Deleting offline snapshot a5e31f28-a1bc-47e3-9a23-de4fb9038628 of volume ec2121aa-49af-443c-8aeb-c9bd2874fe06 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] snapshot_file for this snap is: volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[76db578c-0808-46e3-9f72-66de46f44a8d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:30 devstack sudo[89673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628 Feb 27 02:09:30 devstack sudo[89673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:31 devstack sudo[89673]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628" returned: 0 in 0.465s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:31 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:31 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9356305-34da-49b0-8137-237b2bf96b51]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:31 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06 Feb 27 02:09:31 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:31 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06" returned: 0 in 0.518s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:31 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628 Feb 27 02:09:31 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-14ff728b-0951-463a-9493-a910227af267 tempest-VolumesExtendTest-779188539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-14ff728b-0951-463a-9493-a910227af267 tempest-VolumesExtendTest-779188539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:31 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-14ff728b-0951-463a-9493-a910227af267 tempest-VolumesExtendTest-779188539 None] Creating offline snapshot 89086ee8-3d51-4d51-9615-2fb172ea6a7b of volume 11bbf4dc-3a60-4fc7-a8ce-9c491e85974c {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:09:31 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c533b3-f049-4db7-8282-fd737ce132f9]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14ff728b-0951-463a-9493-a910227af267 tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:31 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c Feb 27 02:09:31 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:32 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628" returned: 0 in 0.478s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:32 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628 Feb 27 02:09:32 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:32 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14ff728b-0951-463a-9493-a910227af267 tempest-VolumesExtendTest-779188539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c" returned: 0 in 0.498s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14ff728b-0951-463a-9493-a910227af267 tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:32 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b 1G Feb 27 02:09:32 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:32 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06.a5e31f28-a1bc-47e3-9a23-de4fb9038628" returned: 0 in 0.409s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-quobyte-a5e31f28-a1bc-47e3-9a23-de4fb9038628" released by "_delete_snapshot" :: held 1.933s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-quobyte-ec2121aa-49af-443c-8aeb-c9bd2874fe06" released by "delete_snapshot" :: held 1.947s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:32 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] Created reservations ['0c482b19-392f-4d4c-be29-2e9c05aeb253', 'c9a26d50-9dfb-4abe-bc6b-3868b4867301', 'f05d2771-b9bd-40ae-81f6-d30720d47d97', '0d9a1a8a-7e65-49b6-b164-becd13a22e9a'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:32 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] Delete snapshot completed successfully. Feb 27 02:09:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3acc8dcf-d99f-4850-aafb-01d831ee01ec tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-a5e31f28-a1bc-47e3-9a23-de4fb9038628-delete_snapshot" released by "delete_snapshot" :: held 2.086s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "cinder-ec2121aa-49af-443c-8aeb-c9bd2874fe06-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-ec2121aa-49af-443c-8aeb-c9bd2874fe06-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "cinder-quobyte-ec2121aa-49af-443c-8aeb-c9bd2874fe06" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:32 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-quobyte-ec2121aa-49af-443c-8aeb-c9bd2874fe06" acquired by "delete_volume" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14ff728b-0951-463a-9493-a910227af267 tempest-VolumesExtendTest-779188539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b 1G" returned: 0 in 0.585s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14ff728b-0951-463a-9493-a910227af267 tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:32 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdc53ae-adb4-4874-8e18-71d8c2e67056]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:32 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b Feb 27 02:09:32 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:32 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06 Feb 27 02:09:32 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:33 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14ff728b-0951-463a-9493-a910227af267 tempest-VolumesExtendTest-779188539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b" returned: 0 in 0.477s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:33 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-14ff728b-0951-463a-9493-a910227af267 tempest-VolumesExtendTest-779188539 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b is being set with open permissions: ugo+rw Feb 27 02:09:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14ff728b-0951-463a-9493-a910227af267 tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:33 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b Feb 27 02:09:33 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:33 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06" returned: 0 in 0.525s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:33 devstack sudo[89714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06 Feb 27 02:09:33 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:33 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14ff728b-0951-463a-9493-a910227af267 tempest-VolumesExtendTest-779188539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b" returned: 0 in 0.495s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:33 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ec2121aa-49af-443c-8aeb-c9bd2874fe06" returned: 0 in 0.448s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-quobyte-ec2121aa-49af-443c-8aeb-c9bd2874fe06" released by "delete_volume" :: held 1.023s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14ff728b-0951-463a-9493-a910227af267 tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:33 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.info Feb 27 02:09:33 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:33 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] Created reservations ['f96e6798-9b12-471f-b6ee-4c9518a3d6ac', '95f363c9-f687-4f34-9de2-63d2cd490003', 'bd700272-0a4a-4198-9754-dd19fcd0ed79', '9e5b6284-6d29-4c53-b21a-140393d7a6b7'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:33 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:33 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:34 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:34 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:34 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14ff728b-0951-463a-9493-a910227af267 tempest-VolumesExtendTest-779188539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.info" returned: 0 in 0.458s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:34 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-14ff728b-0951-463a-9493-a910227af267 tempest-VolumesExtendTest-779188539 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.info is being set with open permissions: ugo+rw Feb 27 02:09:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14ff728b-0951-463a-9493-a910227af267 tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:34 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.info Feb 27 02:09:34 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:34 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.484s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:34 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:34 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] Deleted volume successfully. Feb 27 02:09:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a67b80e6-ad3f-405c-b2e3-92a7ca974967 tempest-CreateVolumesFromSnapshotTest-927141897 None] Lock "cinder-ec2121aa-49af-443c-8aeb-c9bd2874fe06-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:34 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14ff728b-0951-463a-9493-a910227af267 tempest-VolumesExtendTest-779188539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.info" returned: 0 in 0.487s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-14ff728b-0951-463a-9493-a910227af267 tempest-VolumesExtendTest-779188539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.081s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:34 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-14ff728b-0951-463a-9493-a910227af267 tempest-VolumesExtendTest-779188539 None] Create snapshot completed successfully Feb 27 02:09:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0e1aeaef-689b-42dd-a564-74dfb160787a tempest-VolumesExtendTest-779188539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0e1aeaef-689b-42dd-a564-74dfb160787a tempest-VolumesExtendTest-779188539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:36 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[781ac65b-e3e5-42f8-93c9-5db2e3d9ee9a]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0e1aeaef-689b-42dd-a564-74dfb160787a tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:36 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c Feb 27 02:09:36 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:36 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0e1aeaef-689b-42dd-a564-74dfb160787a tempest-VolumesExtendTest-779188539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c" returned: 0 in 0.573s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0e1aeaef-689b-42dd-a564-74dfb160787a tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b 2G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-0e1aeaef-689b-42dd-a564-74dfb160787a tempest-VolumesExtendTest-779188539 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b 2G" returned: 0 in 0.082s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-0e1aeaef-689b-42dd-a564-74dfb160787a tempest-VolumesExtendTest-779188539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.674s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:36 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-0e1aeaef-689b-42dd-a564-74dfb160787a tempest-VolumesExtendTest-779188539 None] Extend volume completed successfully. Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Flow 'volume_create_manager' (06438caa-6b19-4df1-85b5-30897249d5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62607d2-bfbf-41f4-baca-71c4dea22887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62607d2-bfbf-41f4-baca-71c4dea22887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-857886522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23cac11b-16b0-45a9-b4fc-e1475614530e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da52234e5aec4d2d82ab761f70adabcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:37Z,use_quota=True,user_id='3dae29fabaec4477aa71fc6cd67f1e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2803f9dc-b127-4b34-9f45-36b853b36e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2803f9dc-b127-4b34-9f45-36b853b36e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18fac5e-ef50-41e8-b77f-71e84ed6a5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18fac5e-ef50-41e8-b77f-71e84ed6a5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23cac11b-16b0-45a9-b4fc-e1475614530e', 'volume_name': 'volume-23cac11b-16b0-45a9-b4fc-e1475614530e', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ae09b7-7eed-4de4-bb21-e7698eb60be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ae09b7-7eed-4de4-bb21-e7698eb60be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033d08c7-c681-42cb-9952-626e370cc7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:37 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Volume 23cac11b-16b0-45a9-b4fc-e1475614530e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23cac11b-16b0-45a9-b4fc-e1475614530e', 'volume_size': 1} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-857886522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23cac11b-16b0-45a9-b4fc-e1475614530e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da52234e5aec4d2d82ab761f70adabcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:37Z,use_quota=True,user_id='3dae29fabaec4477aa71fc6cd67f1e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Creating volume 23cac11b-16b0-45a9-b4fc-e1475614530e {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:37 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-23cac11b-16b0-45a9-b4fc-e1475614530e 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:37 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-23cac11b-16b0-45a9-b4fc-e1475614530e 1073741824 Feb 27 02:09:37 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] Acquiring lock "cinder-89086ee8-3d51-4d51-9615-2fb172ea6a7b-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] Lock "cinder-89086ee8-3d51-4d51-9615-2fb172ea6a7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] Acquiring lock "cinder-quobyte-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] Lock "cinder-quobyte-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] Acquiring lock "cinder-quobyte-89086ee8-3d51-4d51-9615-2fb172ea6a7b" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] Lock "cinder-quobyte-89086ee8-3d51-4d51-9615-2fb172ea6a7b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] Deleting offline snapshot 89086ee8-3d51-4d51-9615-2fb172ea6a7b of volume 11bbf4dc-3a60-4fc7-a8ce-9c491e85974c {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] snapshot_file for this snap is: volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac3574e-d746-4b5e-a576-68feabac58b8]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:37 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b Feb 27 02:09:37 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:37 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-23cac11b-16b0-45a9-b4fc-e1475614530e 1073741824" returned: 0 in 0.595s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:37 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b" returned: 0 in 0.498s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa10fd72-e9d9-4b09-9fac-a3863f931187]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-23cac11b-16b0-45a9-b4fc-e1475614530e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:37 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-23cac11b-16b0-45a9-b4fc-e1475614530e Feb 27 02:09:37 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:37 devstack sudo[89747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c Feb 27 02:09:37 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:38 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-23cac11b-16b0-45a9-b4fc-e1475614530e" returned: 0 in 0.441s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:38 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033d08c7-c681-42cb-9952-626e370cc7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23cac11b-16b0-45a9-b4fc-e1475614530e', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f8afa8-87bb-4e98-bedd-076fb4a54ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:38 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Volume volume-23cac11b-16b0-45a9-b4fc-e1475614530e (23cac11b-16b0-45a9-b4fc-e1475614530e): created successfully Feb 27 02:09:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f8afa8-87bb-4e98-bedd-076fb4a54ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Flow 'volume_create_manager' (06438caa-6b19-4df1-85b5-30897249d5d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:38 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-234b72ce-1de4-421a-8ab8-8356b7bbc589 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Created volume successfully. Feb 27 02:09:38 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c" returned: 0 in 0.512s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:38 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b Feb 27 02:09:38 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:38 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b" returned: 0 in 0.482s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:38 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b Feb 27 02:09:38 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:39 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c.89086ee8-3d51-4d51-9615-2fb172ea6a7b" returned: 0 in 0.453s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] Lock "cinder-quobyte-89086ee8-3d51-4d51-9615-2fb172ea6a7b" released by "_delete_snapshot" :: held 2.005s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] Lock "cinder-quobyte-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c" released by "delete_snapshot" :: held 2.018s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] Created reservations ['3f2ede13-4a95-4d6d-a28f-eee7b810f0d5', '44e339e7-3870-4f1a-9e9b-6d3f403e4a66', 'd68ae6e9-cc22-4402-8680-2173b994752b', '5e5340df-c888-4a04-8755-0aa24e6a5d78'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:39 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] Delete snapshot completed successfully. Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-5ca6fc30-5994-4dac-8dac-f7628821e79d tempest-VolumesExtendTest-779188539 None] Lock "cinder-89086ee8-3d51-4d51-9615-2fb172ea6a7b-delete_snapshot" released by "delete_snapshot" :: held 2.155s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Flow 'volume_create_manager' (08d94646-9da8-4964-8326-d612e6d7461a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926c5cb0-8e57-4aa4-b53b-84f9d1302968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926c5cb0-8e57-4aa4-b53b-84f9d1302968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1227022967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871ac39a-441b-4aad-8c76-8ed5d1970afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da52234e5aec4d2d82ab761f70adabcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:40Z,use_quota=True,user_id='3dae29fabaec4477aa71fc6cd67f1e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e56a25c-c2e4-4196-a682-cc8280d4433a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e56a25c-c2e4-4196-a682-cc8280d4433a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac00565-31f5-402b-9397-c3ba1c741c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac00565-31f5-402b-9397-c3ba1c741c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '871ac39a-441b-4aad-8c76-8ed5d1970afe', 'volume_name': 'volume-871ac39a-441b-4aad-8c76-8ed5d1970afe', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0523af08-8623-485b-838f-5fc58fa0eece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0523af08-8623-485b-838f-5fc58fa0eece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ace481-426b-435d-a63b-85e4aac36880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:39 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Volume 871ac39a-441b-4aad-8c76-8ed5d1970afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-871ac39a-441b-4aad-8c76-8ed5d1970afe', 'volume_size': 1} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1227022967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871ac39a-441b-4aad-8c76-8ed5d1970afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da52234e5aec4d2d82ab761f70adabcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:40Z,use_quota=True,user_id='3dae29fabaec4477aa71fc6cd67f1e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Creating volume 871ac39a-441b-4aad-8c76-8ed5d1970afe {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:39 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-871ac39a-441b-4aad-8c76-8ed5d1970afe 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:39 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-871ac39a-441b-4aad-8c76-8ed5d1970afe 1073741824 Feb 27 02:09:39 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Flow 'volume_create_manager' (a0347147-2a16-4f6a-83ab-03309246bb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7bd63f4-eedc-48db-bd20-844bd97826a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7bd63f4-eedc-48db-bd20-844bd97826a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1644327792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb8425b-034f-46fa-870b-6a0bc438b052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da52234e5aec4d2d82ab761f70adabcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:40Z,use_quota=True,user_id='3dae29fabaec4477aa71fc6cd67f1e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e599ab-188d-4b78-bfae-bd8258266bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e599ab-188d-4b78-bfae-bd8258266bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96400694-22a1-4fbe-a595-fdd53c90908b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96400694-22a1-4fbe-a595-fdd53c90908b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb8425b-034f-46fa-870b-6a0bc438b052', 'volume_name': 'volume-deb8425b-034f-46fa-870b-6a0bc438b052', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1788d988-615a-40ed-8c8a-9c31dd468baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1788d988-615a-40ed-8c8a-9c31dd468baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3e1fb0-5fa6-4cb9-917a-563beb4513c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:39 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Volume deb8425b-034f-46fa-870b-6a0bc438b052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb8425b-034f-46fa-870b-6a0bc438b052', 'volume_size': 1} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Flow 'volume_create_manager' (9e2596d5-348a-44d7-9ce1-d02c23550678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07456f2-fa58-45fb-b797-2386ecf05541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07456f2-fa58-45fb-b797-2386ecf05541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1784915123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800354d3-85da-410a-9ea4-6fdb81c5e651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da52234e5aec4d2d82ab761f70adabcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:40Z,use_quota=True,user_id='3dae29fabaec4477aa71fc6cd67f1e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000de1bf-7650-4964-97c3-67935c2df876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000de1bf-7650-4964-97c3-67935c2df876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e451e66-5a60-4cec-8327-d133ceff9598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e451e66-5a60-4cec-8327-d133ceff9598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '800354d3-85da-410a-9ea4-6fdb81c5e651', 'volume_name': 'volume-800354d3-85da-410a-9ea4-6fdb81c5e651', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71407ac-54c1-4b28-8eab-e8df4d49d719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71407ac-54c1-4b28-8eab-e8df4d49d719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cdc8883-38bb-4c21-af5e-629f74c546cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:40 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Volume 800354d3-85da-410a-9ea4-6fdb81c5e651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-800354d3-85da-410a-9ea4-6fdb81c5e651', 'volume_size': 1} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Flow 'volume_create_manager' (a81eb101-9393-44a5-97d7-946e1b6cf79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:40 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e05f14-42fb-422b-9bba-69860a9f9bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-871ac39a-441b-4aad-8c76-8ed5d1970afe 1073741824" returned: 0 in 0.572s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e05f14-42fb-422b-9bba-69860a9f9bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-635573093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d9c5be-af3b-4bdb-8da6-4f47fa39f44b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da52234e5aec4d2d82ab761f70adabcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:40Z,use_quota=True,user_id='3dae29fabaec4477aa71fc6cd67f1e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40a54c5-e44d-4c73-8cf1-d2e6deec492a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40a54c5-e44d-4c73-8cf1-d2e6deec492a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f1bc99-f42a-4333-bb9e-574c44ae07b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f1bc99-f42a-4333-bb9e-574c44ae07b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95d9c5be-af3b-4bdb-8da6-4f47fa39f44b', 'volume_name': 'volume-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb063f9-7361-4e1b-9d35-9085ff5c78d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb063f9-7361-4e1b-9d35-9085ff5c78d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6edf8d-fa61-494d-aa17-ec60d1f98de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:40 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Volume 95d9c5be-af3b-4bdb-8da6-4f47fa39f44b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b', 'volume_size': 1} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-871ac39a-441b-4aad-8c76-8ed5d1970afe {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:40 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-871ac39a-441b-4aad-8c76-8ed5d1970afe Feb 27 02:09:40 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Flow 'volume_create_manager' (3b4fede1-b6c7-41fe-905f-d06c9f58a8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48213248-585a-4bf5-822b-aead5e7ba29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48213248-585a-4bf5-822b-aead5e7ba29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-757098499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc21bb0-e36c-49d4-96b0-346a63219e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da52234e5aec4d2d82ab761f70adabcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:40Z,use_quota=True,user_id='3dae29fabaec4477aa71fc6cd67f1e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a01d283-92f7-47fd-b44b-c0d26ab723fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a01d283-92f7-47fd-b44b-c0d26ab723fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be784e62-e614-4db2-9922-b562bd649e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be784e62-e614-4db2-9922-b562bd649e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bc21bb0-e36c-49d4-96b0-346a63219e5b', 'volume_name': 'volume-0bc21bb0-e36c-49d4-96b0-346a63219e5b', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1057de1f-29d8-4f18-99b4-805813f4ac8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1057de1f-29d8-4f18-99b4-805813f4ac8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d59cd8-554e-41fe-b1e6-6de944ce0956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:40 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Volume 0bc21bb0-e36c-49d4-96b0-346a63219e5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bc21bb0-e36c-49d4-96b0-346a63219e5b', 'volume_size': 1} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] Acquiring lock "cinder-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] Lock "cinder-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] Acquiring lock "cinder-quobyte-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] Lock "cinder-quobyte-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c" acquired by "delete_volume" :: waited 0.012s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ed050e-d414-4126-b9ba-b7828f9caa78]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:40 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c Feb 27 02:09:40 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:40 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-871ac39a-441b-4aad-8c76-8ed5d1970afe" returned: 0 in 0.454s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.903s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1644327792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb8425b-034f-46fa-870b-6a0bc438b052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da52234e5aec4d2d82ab761f70adabcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:40Z,use_quota=True,user_id='3dae29fabaec4477aa71fc6cd67f1e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Creating volume deb8425b-034f-46fa-870b-6a0bc438b052 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:40 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-deb8425b-034f-46fa-870b-6a0bc438b052 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:40 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-deb8425b-034f-46fa-870b-6a0bc438b052 1073741824 Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ace481-426b-435d-a63b-85e4aac36880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-871ac39a-441b-4aad-8c76-8ed5d1970afe', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:40 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57136669-0a96-48e2-a775-74ffaee2a73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:40 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Volume volume-871ac39a-441b-4aad-8c76-8ed5d1970afe (871ac39a-441b-4aad-8c76-8ed5d1970afe): created successfully Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57136669-0a96-48e2-a775-74ffaee2a73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Flow 'volume_create_manager' (08d94646-9da8-4964-8326-d612e6d7461a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:40 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-278e5170-4196-4e15-b901-f277691255ab tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Created volume successfully. Feb 27 02:09:41 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c" returned: 0 in 0.518s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:41 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c Feb 27 02:09:41 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:41 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-deb8425b-034f-46fa-870b-6a0bc438b052 1073741824" returned: 0 in 0.530s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-deb8425b-034f-46fa-870b-6a0bc438b052 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:41 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-deb8425b-034f-46fa-870b-6a0bc438b052 Feb 27 02:09:41 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:41 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c" returned: 0 in 0.421s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] Lock "cinder-quobyte-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c" released by "delete_volume" :: held 0.973s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] Created reservations ['b976805a-8f85-455d-85c3-cd1234f0623f', '4913c899-59c2-4bf3-974d-4de442befca5', '19634090-6724-453a-b846-791c2e6640b5', '90324b29-dff1-4002-9a6c-c2a8c98ca850'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:41 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:41 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:41 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-deb8425b-034f-46fa-870b-6a0bc438b052" returned: 0 in 0.458s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.721s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1784915123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800354d3-85da-410a-9ea4-6fdb81c5e651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da52234e5aec4d2d82ab761f70adabcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:40Z,use_quota=True,user_id='3dae29fabaec4477aa71fc6cd67f1e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Creating volume 800354d3-85da-410a-9ea4-6fdb81c5e651 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:41 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-800354d3-85da-410a-9ea4-6fdb81c5e651 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3e1fb0-5fa6-4cb9-917a-563beb4513c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb8425b-034f-46fa-870b-6a0bc438b052', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8586b315-e676-4dcd-90c0-471fcbffb998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:41 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-800354d3-85da-410a-9ea4-6fdb81c5e651 1073741824 Feb 27 02:09:41 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:41 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Volume volume-deb8425b-034f-46fa-870b-6a0bc438b052 (deb8425b-034f-46fa-870b-6a0bc438b052): created successfully Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8586b315-e676-4dcd-90c0-471fcbffb998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Flow 'volume_create_manager' (a0347147-2a16-4f6a-83ab-03309246bb33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:41 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-bdad312b-2924-495e-8e00-401e09ce2415 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Created volume successfully. Feb 27 02:09:42 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.418s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:42 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] Deleted volume successfully. Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-89b39c91-a6b1-4d97-a919-a6b3b3c9d5d1 tempest-VolumesExtendTest-779188539 None] Lock "cinder-11bbf4dc-3a60-4fc7-a8ce-9c491e85974c-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:42 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-800354d3-85da-410a-9ea4-6fdb81c5e651 1073741824" returned: 0 in 0.509s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-800354d3-85da-410a-9ea4-6fdb81c5e651 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:42 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-800354d3-85da-410a-9ea4-6fdb81c5e651 Feb 27 02:09:42 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:42 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-800354d3-85da-410a-9ea4-6fdb81c5e651" returned: 0 in 0.488s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.541s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-635573093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d9c5be-af3b-4bdb-8da6-4f47fa39f44b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da52234e5aec4d2d82ab761f70adabcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:40Z,use_quota=True,user_id='3dae29fabaec4477aa71fc6cd67f1e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Creating volume 95d9c5be-af3b-4bdb-8da6-4f47fa39f44b {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:42 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=183,cinder:INSERT=69,cinder:UPDATE=224,cinder:DELETE=14 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cdc8883-38bb-4c21-af5e-629f74c546cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-800354d3-85da-410a-9ea4-6fdb81c5e651', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b05ded-127e-4943-8ac6-fc9b5224a023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:42 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b 1073741824 Feb 27 02:09:42 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:UPDATE=256,cinder:DELETE=26,cinder:SELECT=181,cinder:INSERT=58 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:09:42 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Volume volume-800354d3-85da-410a-9ea4-6fdb81c5e651 (800354d3-85da-410a-9ea4-6fdb81c5e651): created successfully Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b05ded-127e-4943-8ac6-fc9b5224a023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Flow 'volume_create_manager' (9e2596d5-348a-44d7-9ce1-d02c23550678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:42 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-1e083d5d-60dc-40af-ae39-f6cbe3eda2dd tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Created volume successfully. Feb 27 02:09:43 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b 1073741824" returned: 0 in 0.585s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:43 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b Feb 27 02:09:43 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:43 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b" returned: 0 in 0.511s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:43 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.465s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:43 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-757098499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc21bb0-e36c-49d4-96b0-346a63219e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da52234e5aec4d2d82ab761f70adabcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:40Z,use_quota=True,user_id='3dae29fabaec4477aa71fc6cd67f1e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:43 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Creating volume 0bc21bb0-e36c-49d4-96b0-346a63219e5b {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:43 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:43 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:43 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:43 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:09:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0bc21bb0-e36c-49d4-96b0-346a63219e5b 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:43 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6edf8d-fa61-494d-aa17-ec60d1f98de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:43 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7cbf81d-8e69-4628-8f7b-96df80966599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:43 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0bc21bb0-e36c-49d4-96b0-346a63219e5b 1073741824 Feb 27 02:09:43 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:43 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Volume volume-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b (95d9c5be-af3b-4bdb-8da6-4f47fa39f44b): created successfully Feb 27 02:09:43 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7cbf81d-8e69-4628-8f7b-96df80966599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:43 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Flow 'volume_create_manager' (a81eb101-9393-44a5-97d7-946e1b6cf79c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:43 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-11e91330-7fa5-4fe4-8806-3a79820bb90e tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Created volume successfully. Feb 27 02:09:44 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0bc21bb0-e36c-49d4-96b0-346a63219e5b 1073741824" returned: 0 in 0.579s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0bc21bb0-e36c-49d4-96b0-346a63219e5b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:44 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0bc21bb0-e36c-49d4-96b0-346a63219e5b Feb 27 02:09:44 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:44 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Flow 'volume_create_manager' (8ac60bd7-4b2b-4be6-a616-450cbb85f107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0583a18-0749-473c-af17-9504dea76939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0583a18-0749-473c-af17-9504dea76939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-705713950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66af87cf-c30d-4a35-bf20-23fe3c0b48a6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='140c6f28a1e841d09acae73b7f1b1fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:45Z,use_quota=True,user_id='d96443f2bab743369770199d778d14df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3895ae17-2b32-4909-bd09-2da6e51d50b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3895ae17-2b32-4909-bd09-2da6e51d50b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c852f06-9560-46c3-8792-27f5cdd58c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c852f06-9560-46c3-8792-27f5cdd58c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66af87cf-c30d-4a35-bf20-23fe3c0b48a6', 'volume_name': 'volume-66af87cf-c30d-4a35-bf20-23fe3c0b48a6', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df61095-7e73-4e6b-80d6-027ba8d5342d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df61095-7e73-4e6b-80d6-027ba8d5342d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d118632d-8943-40de-86a7-0640df1eb896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Volume 66af87cf-c30d-4a35-bf20-23fe3c0b48a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66af87cf-c30d-4a35-bf20-23fe3c0b48a6', 'volume_size': 1} Feb 27 02:09:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:44 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0bc21bb0-e36c-49d4-96b0-346a63219e5b" returned: 0 in 0.467s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:44 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.198s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-705713950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66af87cf-c30d-4a35-bf20-23fe3c0b48a6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='140c6f28a1e841d09acae73b7f1b1fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:45Z,use_quota=True,user_id='d96443f2bab743369770199d778d14df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Creating volume 66af87cf-c30d-4a35-bf20-23fe3c0b48a6 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:45 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-66af87cf-c30d-4a35-bf20-23fe3c0b48a6 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d59cd8-554e-41fe-b1e6-6de944ce0956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bc21bb0-e36c-49d4-96b0-346a63219e5b', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:45 devstack sudo[89815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-66af87cf-c30d-4a35-bf20-23fe3c0b48a6 1073741824 Feb 27 02:09:45 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e45117-8212-4ada-bb9f-e9ffd17e26b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:45 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Volume volume-0bc21bb0-e36c-49d4-96b0-346a63219e5b (0bc21bb0-e36c-49d4-96b0-346a63219e5b): created successfully Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e45117-8212-4ada-bb9f-e9ffd17e26b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Flow 'volume_create_manager' (3b4fede1-b6c7-41fe-905f-d06c9f58a8cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:45 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-91e7d596-3036-4ebb-90f8-847bf1b2b115 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Created volume successfully. Feb 27 02:09:45 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-66af87cf-c30d-4a35-bf20-23fe3c0b48a6 1073741824" returned: 0 in 0.559s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-66af87cf-c30d-4a35-bf20-23fe3c0b48a6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:45 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-66af87cf-c30d-4a35-bf20-23fe3c0b48a6 Feb 27 02:09:45 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "cinder-0bc21bb0-e36c-49d4-96b0-346a63219e5b-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-0bc21bb0-e36c-49d4-96b0-346a63219e5b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "cinder-quobyte-0bc21bb0-e36c-49d4-96b0-346a63219e5b" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-quobyte-0bc21bb0-e36c-49d4-96b0-346a63219e5b" acquired by "delete_volume" :: waited 0.017s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[336fc690-e582-4b34-b707-6019a234cc86]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0bc21bb0-e36c-49d4-96b0-346a63219e5b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:46 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0bc21bb0-e36c-49d4-96b0-346a63219e5b Feb 27 02:09:46 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:46 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-66af87cf-c30d-4a35-bf20-23fe3c0b48a6" returned: 0 in 0.462s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:46 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d118632d-8943-40de-86a7-0640df1eb896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66af87cf-c30d-4a35-bf20-23fe3c0b48a6', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:46 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345fc88c-f686-48f5-a691-f057959f0ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:46 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Volume volume-66af87cf-c30d-4a35-bf20-23fe3c0b48a6 (66af87cf-c30d-4a35-bf20-23fe3c0b48a6): created successfully Feb 27 02:09:46 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345fc88c-f686-48f5-a691-f057959f0ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:46 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Flow 'volume_create_manager' (8ac60bd7-4b2b-4be6-a616-450cbb85f107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:46 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-ecf7a154-67ad-4718-b2e0-f3fe1b6cd9a2 tempest-VolumesGetTest-84263323 None] Created volume successfully. Feb 27 02:09:46 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0bc21bb0-e36c-49d4-96b0-346a63219e5b" returned: 0 in 0.515s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0bc21bb0-e36c-49d4-96b0-346a63219e5b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:46 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0bc21bb0-e36c-49d4-96b0-346a63219e5b Feb 27 02:09:46 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:46 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0bc21bb0-e36c-49d4-96b0-346a63219e5b" returned: 0 in 0.530s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-quobyte-0bc21bb0-e36c-49d4-96b0-346a63219e5b" released by "delete_volume" :: held 1.071s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Created reservations ['703c09b2-63c3-49ea-8596-0e5436dc3d84', '7421b5c6-4336-47b0-8343-f21c4df40f5e', '0895c309-a80b-451e-a1be-e60e15818d93', 'bde5f24f-a10e-4186-a1b7-ca28d178aea4'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:47 devstack sudo[89831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:47 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG oslo_service.periodic_task [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83231) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:47 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:47 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Flow 'volume_create_manager' (55e7a77e-855a-4899-9213-9ea022b4356c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12571015-7ce6-4487-8da0-1ad01958346c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12571015-7ce6-4487-8da0-1ad01958346c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1448307577',display_name='tempest-VolumesGetTest-Volume-978483904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b4d863-9bd8-41ca-b774-00ca68a41774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140c6f28a1e841d09acae73b7f1b1fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:47Z,use_quota=True,user_id='d96443f2bab743369770199d778d14df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b504df65-f2ad-4c24-bf68-90a906cf3588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b504df65-f2ad-4c24-bf68-90a906cf3588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c80f6f3-e94a-4586-8c41-01c6a72c97a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c80f6f3-e94a-4586-8c41-01c6a72c97a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80b4d863-9bd8-41ca-b774-00ca68a41774', 'volume_name': 'volume-80b4d863-9bd8-41ca-b774-00ca68a41774', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4229ddf-5f06-4236-ad82-cef5355e705b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4229ddf-5f06-4236-ad82-cef5355e705b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7edaa1-0724-4c5f-80f5-b994935f1aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:47 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Volume 80b4d863-9bd8-41ca-b774-00ca68a41774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80b4d863-9bd8-41ca-b774-00ca68a41774', 'volume_size': 1} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1448307577',display_name='tempest-VolumesGetTest-Volume-978483904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b4d863-9bd8-41ca-b774-00ca68a41774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140c6f28a1e841d09acae73b7f1b1fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:47Z,use_quota=True,user_id='d96443f2bab743369770199d778d14df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Creating volume 80b4d863-9bd8-41ca-b774-00ca68a41774 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:47 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-80b4d863-9bd8-41ca-b774-00ca68a41774 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:47 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-80b4d863-9bd8-41ca-b774-00ca68a41774 1073741824 Feb 27 02:09:47 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:47 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.546s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:47 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Deleted volume successfully. Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-e5da76ef-ca02-4008-8531-7abdd35d3bce tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-0bc21bb0-e36c-49d4-96b0-346a63219e5b-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:47 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.526s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:47 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:48 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-80b4d863-9bd8-41ca-b774-00ca68a41774 1073741824" returned: 0 in 0.522s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-80b4d863-9bd8-41ca-b774-00ca68a41774 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:48 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-80b4d863-9bd8-41ca-b774-00ca68a41774 Feb 27 02:09:48 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "cinder-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "cinder-quobyte-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-quobyte-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b" acquired by "delete_volume" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:48 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3529b12f-3dc4-4edb-93cd-8bc9af1d4ea3]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:48 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b Feb 27 02:09:48 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:48 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-80b4d863-9bd8-41ca-b774-00ca68a41774" returned: 0 in 0.456s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:48 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7edaa1-0724-4c5f-80f5-b994935f1aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80b4d863-9bd8-41ca-b774-00ca68a41774', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292cbba6-edd2-40aa-a0f9-58601f781dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:48 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Volume volume-80b4d863-9bd8-41ca-b774-00ca68a41774 (80b4d863-9bd8-41ca-b774-00ca68a41774): created successfully Feb 27 02:09:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292cbba6-edd2-40aa-a0f9-58601f781dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Flow 'volume_create_manager' (55e7a77e-855a-4899-9213-9ea022b4356c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:48 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-8500c64d-c7cc-4843-a5a6-b6ed2f1c2b8f tempest-VolumesGetTest-84263323 None] Created volume successfully. Feb 27 02:09:48 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b" returned: 0 in 0.598s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:48 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b Feb 27 02:09:48 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:49 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b" returned: 0 in 0.460s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:49 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-quobyte-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b" released by "delete_volume" :: held 1.091s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:49 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Created reservations ['4535705a-0c43-4586-b02d-b07a0285a949', '45af1547-2567-46c8-9f21-ccf965914675', 'd0345c91-8ab1-4787-8cab-d9c9d096d2b9', '5308ddc4-42fd-4979-98ec-1b366df136a2'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:49 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:49 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:49 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] Acquiring lock "cinder-80b4d863-9bd8-41ca-b774-00ca68a41774-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:49 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] Lock "cinder-80b4d863-9bd8-41ca-b774-00ca68a41774-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:49 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] Acquiring lock "cinder-quobyte-80b4d863-9bd8-41ca-b774-00ca68a41774" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:49 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] Lock "cinder-quobyte-80b4d863-9bd8-41ca-b774-00ca68a41774" acquired by "delete_volume" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:49 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aace00-66a8-4a28-8eaf-b9e0fb0a0fb1]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-80b4d863-9bd8-41ca-b774-00ca68a41774 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:49 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.454s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:49 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:49 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-80b4d863-9bd8-41ca-b774-00ca68a41774 Feb 27 02:09:49 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:49 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Deleted volume successfully. Feb 27 02:09:49 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dcc32855-e015-4676-8219-e7e81c283c28 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-95d9c5be-af3b-4bdb-8da6-4f47fa39f44b-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "cinder-800354d3-85da-410a-9ea4-6fdb81c5e651-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-800354d3-85da-410a-9ea4-6fdb81c5e651-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "cinder-quobyte-800354d3-85da-410a-9ea4-6fdb81c5e651" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-quobyte-800354d3-85da-410a-9ea4-6fdb81c5e651" acquired by "delete_volume" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:50 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[917b3079-ad49-40b3-8a24-749ce4b9a841]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-800354d3-85da-410a-9ea4-6fdb81c5e651 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:50 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-80b4d863-9bd8-41ca-b774-00ca68a41774" returned: 0 in 0.656s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-80b4d863-9bd8-41ca-b774-00ca68a41774 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:50 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-80b4d863-9bd8-41ca-b774-00ca68a41774 Feb 27 02:09:50 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:50 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-800354d3-85da-410a-9ea4-6fdb81c5e651 Feb 27 02:09:50 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:50 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-80b4d863-9bd8-41ca-b774-00ca68a41774" returned: 0 in 0.429s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] Lock "cinder-quobyte-80b4d863-9bd8-41ca-b774-00ca68a41774" released by "delete_volume" :: held 1.113s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:50 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] Created reservations ['d2aa6633-6389-468d-b8ea-0e93caa235d3', '595b882f-e145-438d-b9fa-884ce0056f6d', '9a9978fc-d317-45e1-aeb3-9390470efbf0', '42340531-b3b5-4ab4-b62e-c7e485729a9e'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:50 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-800354d3-85da-410a-9ea4-6fdb81c5e651" returned: 0 in 0.586s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-800354d3-85da-410a-9ea4-6fdb81c5e651 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:50 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:50 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:50 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-800354d3-85da-410a-9ea4-6fdb81c5e651 Feb 27 02:09:50 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:51 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.404s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:51 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:51 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] Deleted volume successfully. Feb 27 02:09:51 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7f11869f-7f64-44d4-bed0-f094db6baf3b tempest-VolumesGetTest-84263323 None] Lock "cinder-80b4d863-9bd8-41ca-b774-00ca68a41774-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:51 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-800354d3-85da-410a-9ea4-6fdb81c5e651" returned: 0 in 0.520s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:51 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-quobyte-800354d3-85da-410a-9ea4-6fdb81c5e651" released by "delete_volume" :: held 1.140s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:51 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Created reservations ['4a957ee2-edf8-493b-b3a1-6fb2ca7fe82e', 'dbc6735d-2e2d-49f0-bdab-081cebf8139f', '32db566a-4f80-4aca-801a-f7ef8110390c', '9d542bd0-6072-48c4-976f-9b88f63aa31a'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:51 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:51 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:51 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:51 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:51 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] Acquiring lock "cinder-66af87cf-c30d-4a35-bf20-23fe3c0b48a6-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:51 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] Lock "cinder-66af87cf-c30d-4a35-bf20-23fe3c0b48a6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:51 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] Acquiring lock "cinder-quobyte-66af87cf-c30d-4a35-bf20-23fe3c0b48a6" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:51 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] Lock "cinder-quobyte-66af87cf-c30d-4a35-bf20-23fe3c0b48a6" acquired by "delete_volume" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:51 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d52bcb9-1ad9-4ce0-801f-ad1fd691aeab]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-66af87cf-c30d-4a35-bf20-23fe3c0b48a6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:52 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-66af87cf-c30d-4a35-bf20-23fe3c0b48a6 Feb 27 02:09:52 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:52 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.490s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:52 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Deleted volume successfully. Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-03fa44a9-2bca-44dc-815b-6cbd8b253ba4 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-800354d3-85da-410a-9ea4-6fdb81c5e651-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:52 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-66af87cf-c30d-4a35-bf20-23fe3c0b48a6" returned: 0 in 0.460s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-66af87cf-c30d-4a35-bf20-23fe3c0b48a6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:52 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-66af87cf-c30d-4a35-bf20-23fe3c0b48a6 Feb 27 02:09:52 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "cinder-deb8425b-034f-46fa-870b-6a0bc438b052-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-deb8425b-034f-46fa-870b-6a0bc438b052-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "cinder-quobyte-deb8425b-034f-46fa-870b-6a0bc438b052" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-quobyte-deb8425b-034f-46fa-870b-6a0bc438b052" acquired by "delete_volume" :: waited 0.007s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c894a75-8c4b-4a7b-81ee-39b59ac8f85f]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-deb8425b-034f-46fa-870b-6a0bc438b052 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:52 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-deb8425b-034f-46fa-870b-6a0bc438b052 Feb 27 02:09:52 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:52 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-66af87cf-c30d-4a35-bf20-23fe3c0b48a6" returned: 0 in 0.406s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] Lock "cinder-quobyte-66af87cf-c30d-4a35-bf20-23fe3c0b48a6" released by "delete_volume" :: held 0.896s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] Created reservations ['22202b90-e912-4952-919e-ed25d276e3e9', '3fa07ade-4426-4a6d-a3b6-7618697696c6', '62fb59da-4a61-4e11-82a5-c12351260b82', '06b637f2-0789-4d51-8077-a80e098d53c4'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:52 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:52 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:53 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-deb8425b-034f-46fa-870b-6a0bc438b052" returned: 0 in 0.491s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-deb8425b-034f-46fa-870b-6a0bc438b052 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:53 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-deb8425b-034f-46fa-870b-6a0bc438b052 Feb 27 02:09:53 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Flow 'volume_create_manager' (37b389f5-b311-4082-bdfb-f58b211d61fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26dc38e5-e5f0-4f82-8f94-3bf8a5a40fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26dc38e5-e5f0-4f82-8f94-3bf8a5a40fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1458552500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d738987-8383-4703-bb0b-004662db2482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140c6f28a1e841d09acae73b7f1b1fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:53Z,use_quota=True,user_id='d96443f2bab743369770199d778d14df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25adb35a-fc21-4859-9d3c-f56dd4c2df58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25adb35a-fc21-4859-9d3c-f56dd4c2df58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6496054-98c9-4061-9e82-728b07d2a9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6496054-98c9-4061-9e82-728b07d2a9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d738987-8383-4703-bb0b-004662db2482', 'volume_name': 'volume-2d738987-8383-4703-bb0b-004662db2482', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a16a589-dfd5-43d0-a22b-c4e330ceb61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a16a589-dfd5-43d0-a22b-c4e330ceb61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02fda51c-b226-477e-914f-dfaf4596565a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:53 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Volume 2d738987-8383-4703-bb0b-004662db2482: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d738987-8383-4703-bb0b-004662db2482', 'volume_size': 1} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1458552500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d738987-8383-4703-bb0b-004662db2482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140c6f28a1e841d09acae73b7f1b1fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:53Z,use_quota=True,user_id='d96443f2bab743369770199d778d14df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Creating volume 2d738987-8383-4703-bb0b-004662db2482 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:53 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:53 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.443s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:53 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] Deleted volume successfully. Feb 27 02:09:53 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 1073741824 Feb 27 02:09:53 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b3b1dfee-a09a-4205-84ce-05d02cc5c724 tempest-VolumesGetTest-84263323 None] Lock "cinder-66af87cf-c30d-4a35-bf20-23fe3c0b48a6-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:53 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-deb8425b-034f-46fa-870b-6a0bc438b052" returned: 0 in 0.508s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-quobyte-deb8425b-034f-46fa-870b-6a0bc438b052" released by "delete_volume" :: held 1.026s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Created reservations ['399b9bd4-1b27-48cf-8469-4afe0ab01c8c', '47f06599-6909-442a-acd4-3c6b55e23a4a', '73547d3f-b194-4a30-bc5e-aa0342771859', '90768bc6-7518-41c5-85cd-e5c2e409d14d'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:53 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:53 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:53 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 1073741824" returned: 0 in 0.534s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:53 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 Feb 27 02:09:53 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:54 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.408s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:54 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:54 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Deleted volume successfully. Feb 27 02:09:54 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4b2a0945-d7ca-4419-967e-545c8fa5abe7 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-deb8425b-034f-46fa-870b-6a0bc438b052-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:54 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482" returned: 0 in 0.443s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02fda51c-b226-477e-914f-dfaf4596565a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d738987-8383-4703-bb0b-004662db2482', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12f7538-4633-4451-82e8-ddacbc1f0e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:54 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Volume volume-2d738987-8383-4703-bb0b-004662db2482 (2d738987-8383-4703-bb0b-004662db2482): created successfully Feb 27 02:09:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12f7538-4633-4451-82e8-ddacbc1f0e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Flow 'volume_create_manager' (37b389f5-b311-4082-bdfb-f58b211d61fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:54 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-96165f15-e6eb-41ee-a805-7edac6afba79 tempest-VolumesGetTest-84263323 None] Created volume successfully. Feb 27 02:09:54 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "cinder-871ac39a-441b-4aad-8c76-8ed5d1970afe-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:54 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-871ac39a-441b-4aad-8c76-8ed5d1970afe-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:54 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "cinder-quobyte-871ac39a-441b-4aad-8c76-8ed5d1970afe" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:54 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-quobyte-871ac39a-441b-4aad-8c76-8ed5d1970afe" acquired by "delete_volume" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:54 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a5ad5a-64d0-438d-a381-5f81dfaa85f7]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-871ac39a-441b-4aad-8c76-8ed5d1970afe {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:54 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-871ac39a-441b-4aad-8c76-8ed5d1970afe Feb 27 02:09:54 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:55 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-871ac39a-441b-4aad-8c76-8ed5d1970afe" returned: 0 in 0.530s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-871ac39a-441b-4aad-8c76-8ed5d1970afe {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:55 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-871ac39a-441b-4aad-8c76-8ed5d1970afe Feb 27 02:09:55 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:55 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Flow 'volume_create_manager' (c79d5d8e-aecc-42d5-a798-58db3866da82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066df950-763b-44c8-9422-d161f3cca241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066df950-763b-44c8-9422-d161f3cca241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-160838981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=552d0c28-0815-428a-b009-1746e5ecf931,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='140c6f28a1e841d09acae73b7f1b1fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2d738987-8383-4703-bb0b-004662db2482,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:56Z,use_quota=True,user_id='d96443f2bab743369770199d778d14df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9dfe97c-dc0b-4080-a08c-6334807420d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9dfe97c-dc0b-4080-a08c-6334807420d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df67c86-0a6f-4cb3-91b7-1720eaf1da6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-871ac39a-441b-4aad-8c76-8ed5d1970afe" returned: 0 in 0.513s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df67c86-0a6f-4cb3-91b7-1720eaf1da6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '552d0c28-0815-428a-b009-1746e5ecf931', 'volume_name': 'volume-552d0c28-0815-428a-b009-1746e5ecf931', 'volume_size': 1, 'source_volid': '2d738987-8383-4703-bb0b-004662db2482', 'source_volstatus': 'available'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be993456-3bab-45a4-bed7-11f4b7387a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be993456-3bab-45a4-bed7-11f4b7387a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d502de6-242a-474f-8471-7f41bdd3ba14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:55 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Volume 552d0c28-0815-428a-b009-1746e5ecf931: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-552d0c28-0815-428a-b009-1746e5ecf931', 'volume_size': 1, 'source_volid': '2d738987-8383-4703-bb0b-004662db2482', 'source_volstatus': 'available'} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-quobyte-871ac39a-441b-4aad-8c76-8ed5d1970afe" released by "delete_volume" :: held 1.094s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:55 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Cloning volume 2d738987-8383-4703-bb0b-004662db2482 to volume 552d0c28-0815-428a-b009-1746e5ecf931 Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Creating offline snapshot ba64cc2d-cea2-4743-845e-f602e97fb5aa of volume 2d738987-8383-4703-bb0b-004662db2482 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[626b3aed-5154-46c1-93c7-d8cd012b44cc]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Created reservations ['aedf2aeb-9f24-43bf-9f8a-3382a99403d7', 'cacbce97-2293-4e9d-bfaa-d6d036e84ff1', '1d81d0c8-872d-4007-9cb4-25e3509c4e75', '43eff6c4-e775-4030-a72b-699081a333a7'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:55 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:55 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 Feb 27 02:09:55 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:55 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:56 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:56 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.424s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:56 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:56 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Deleted volume successfully. Feb 27 02:09:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482" returned: 0 in 0.498s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:56 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2cd7050c-6d59-483e-aa01-6663e1f06c01 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-871ac39a-441b-4aad-8c76-8ed5d1970afe-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:56 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa 1G Feb 27 02:09:56 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:56 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "cinder-23cac11b-16b0-45a9-b4fc-e1475614530e-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:56 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-23cac11b-16b0-45a9-b4fc-e1475614530e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:56 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa 1G" returned: 0 in 0.539s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d738987-8383-4703-bb0b-004662db2482 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:56 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "cinder-quobyte-23cac11b-16b0-45a9-b4fc-e1475614530e" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:56 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d738987-8383-4703-bb0b-004662db2482 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa Feb 27 02:09:56 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:56 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-quobyte-23cac11b-16b0-45a9-b4fc-e1475614530e" acquired by "delete_volume" :: waited 0.015s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:56 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b4e41f-b6d1-48ca-811f-600f26791114]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:56 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-23cac11b-16b0-45a9-b4fc-e1475614530e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:57 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-23cac11b-16b0-45a9-b4fc-e1475614530e Feb 27 02:09:57 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:57 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d738987-8383-4703-bb0b-004662db2482 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa" returned: 0 in 0.497s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:57 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa is being set with open permissions: ugo+rw Feb 27 02:09:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:57 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa Feb 27 02:09:57 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:57 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-23cac11b-16b0-45a9-b4fc-e1475614530e" returned: 0 in 0.511s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-23cac11b-16b0-45a9-b4fc-e1475614530e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:57 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-23cac11b-16b0-45a9-b4fc-e1475614530e Feb 27 02:09:57 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:57 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa" returned: 0 in 0.455s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:57 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-23cac11b-16b0-45a9-b4fc-e1475614530e" returned: 0 in 0.434s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:57 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-quobyte-23cac11b-16b0-45a9-b4fc-e1475614530e" released by "delete_volume" :: held 0.972s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:57 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.info Feb 27 02:09:57 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:57 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Created reservations ['7291e017-3547-4103-a006-74cba678ee73', 'f2346124-7d93-4d77-8a2c-822b7c9ae7b3', '1ebb08ac-ca52-4b34-b919-402f6724ca91', 'c2491501-66bb-482b-95b8-c115db614f21'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:57 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:57 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:58 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:09:58 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:58 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.info" returned: 0 in 0.453s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:58 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.info is being set with open permissions: ugo+rw Feb 27 02:09:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:58 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.info Feb 27 02:09:58 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:58 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.408s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:58 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:58 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Deleted volume successfully. Feb 27 02:09:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-adde1a8a-5ea1-4e09-a12a-356bb29e8902 tempest-CreateVolumesFromSourceVolumeTest-1140934415 None] Lock "cinder-23cac11b-16b0-45a9-b4fc-e1475614530e-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:58 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.info" returned: 0 in 0.387s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Acquiring lock "cinder-quobyte-552d0c28-0815-428a-b009-1746e5ecf931" by "_copy_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Lock "cinder-quobyte-552d0c28-0815-428a-b009-1746e5ecf931" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] snapshot: ba64cc2d-cea2-4743-845e-f602e97fb5aa, volume: 552d0c28-0815-428a-b009-1746e5ecf931, {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:09:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:58 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8151e0ed-9648-4f15-afd1-e31609588150]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:58 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa Feb 27 02:09:58 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:59 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa" returned: 0 in 0.513s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d738987-8383-4703-bb0b-004662db2482(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:09:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Creating direct copy from snapshot {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:09:59 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0c396a-2005-4fee-8769-7897489f1f0e]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:59 devstack sudo[89963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 Feb 27 02:09:59 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:59 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482" returned: 0 in 0.569s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:59 devstack cinder-volume[83231]: DEBUG cinder.utils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Path /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-552d0c28-0815-428a-b009-1746e5ecf931 not found in is_blk_device check {{(pid=83231) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:09:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-552d0c28-0815-428a-b009-1746e5ecf931 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:59 devstack sudo[89968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-552d0c28-0815-428a-b009-1746e5ecf931 Feb 27 02:09:59 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:01 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-552d0c28-0815-428a-b009-1746e5ecf931" returned: 0 in 2.124s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:01 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[978fdbf1-811e-4145-8c2a-aefbdae50207]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:02 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 Feb 27 02:10:02 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:02 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482" returned: 0 in 0.758s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:02 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Image conversion details: src /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482, size 1024.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-552d0c28-0815-428a-b009-1746e5ecf931 {{(pid=83231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:10:02 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Converted 1024.00 MB image at 481.82 MB/s Feb 27 02:10:02 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-552d0c28-0815-428a-b009-1746e5ecf931 is being set with open permissions: ugo+rw Feb 27 02:10:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-552d0c28-0815-428a-b009-1746e5ecf931 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:02 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-552d0c28-0815-428a-b009-1746e5ecf931 Feb 27 02:10:02 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:03 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-552d0c28-0815-428a-b009-1746e5ecf931" returned: 0 in 0.492s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Lock "cinder-quobyte-552d0c28-0815-428a-b009-1746e5ecf931" released by "_copy_volume_from_snapshot" :: held 4.506s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Acquiring lock "cinder-quobyte-ba64cc2d-cea2-4743-845e-f602e97fb5aa" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Lock "cinder-quobyte-ba64cc2d-cea2-4743-845e-f602e97fb5aa" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Deleting offline snapshot ba64cc2d-cea2-4743-845e-f602e97fb5aa of volume 2d738987-8383-4703-bb0b-004662db2482 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:10:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] snapshot_file for this snap is: volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:10:03 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7663a01a-33b2-4913-ba77-dd09f73340aa]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:03 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa Feb 27 02:10:03 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:03 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa" returned: 0 in 0.532s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d738987-8383-4703-bb0b-004662db2482(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:10:03 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74d8ee3-9e92-44a3-ad10-5005a924511b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:03 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 Feb 27 02:10:03 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:04 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482" returned: 0 in 0.551s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:04 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa Feb 27 02:10:04 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:04 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa" returned: 0 in 0.492s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:04 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa Feb 27 02:10:04 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:05 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482.ba64cc2d-cea2-4743-845e-f602e97fb5aa" returned: 0 in 0.421s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Lock "cinder-quobyte-ba64cc2d-cea2-4743-845e-f602e97fb5aa" released by "_delete_snapshot" :: held 2.072s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.541s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d502de6-242a-474f-8471-7f41bdd3ba14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-552d0c28-0815-428a-b009-1746e5ecf931', 'volume_size': 1, 'source_volid': '2d738987-8383-4703-bb0b-004662db2482', 'source_volstatus': 'available'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775e9976-5819-483b-b6aa-439d8660e80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:05 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Volume volume-552d0c28-0815-428a-b009-1746e5ecf931 (552d0c28-0815-428a-b009-1746e5ecf931): created successfully Feb 27 02:10:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775e9976-5819-483b-b6aa-439d8660e80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Flow 'volume_create_manager' (c79d5d8e-aecc-42d5-a798-58db3866da82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:05 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-4e6c21e5-321c-4d70-b167-4b95d224328c tempest-VolumesGetTest-84263323 None] Created volume successfully. Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Flow 'volume_create_manager' (b6c012c2-0c52-445b-bae5-16376213c658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ecead9a-1404-4dae-9919-b62383915d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ecead9a-1404-4dae-9919-b62383915d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1915373136',display_name='tempest-VolumesGetTest-Volume-18981207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cec3fd8-9534-4ccc-85b2-d58e96de6e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140c6f28a1e841d09acae73b7f1b1fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:07Z,use_quota=True,user_id='d96443f2bab743369770199d778d14df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a742d60-f480-403e-b14a-dfedf808ecc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a742d60-f480-403e-b14a-dfedf808ecc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54a429f-5301-46e0-888f-c08c28942b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54a429f-5301-46e0-888f-c08c28942b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cec3fd8-9534-4ccc-85b2-d58e96de6e31', 'volume_name': 'volume-5cec3fd8-9534-4ccc-85b2-d58e96de6e31', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f6d3b4-4e9a-4821-85f2-b911c472eea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f6d3b4-4e9a-4821-85f2-b911c472eea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba189a5-936a-4281-b81a-42e3f697ba49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:06 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Volume 5cec3fd8-9534-4ccc-85b2-d58e96de6e31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cec3fd8-9534-4ccc-85b2-d58e96de6e31', 'volume_size': 1} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1915373136',display_name='tempest-VolumesGetTest-Volume-18981207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cec3fd8-9534-4ccc-85b2-d58e96de6e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140c6f28a1e841d09acae73b7f1b1fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:07Z,use_quota=True,user_id='d96443f2bab743369770199d778d14df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Creating volume 5cec3fd8-9534-4ccc-85b2-d58e96de6e31 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:06 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:10:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5cec3fd8-9534-4ccc-85b2-d58e96de6e31 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:06 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5cec3fd8-9534-4ccc-85b2-d58e96de6e31 1073741824 Feb 27 02:10:06 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:07 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5cec3fd8-9534-4ccc-85b2-d58e96de6e31 1073741824" returned: 0 in 0.680s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5cec3fd8-9534-4ccc-85b2-d58e96de6e31 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:07 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5cec3fd8-9534-4ccc-85b2-d58e96de6e31 Feb 27 02:10:07 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:08 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5cec3fd8-9534-4ccc-85b2-d58e96de6e31" returned: 0 in 0.520s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:08 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba189a5-936a-4281-b81a-42e3f697ba49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cec3fd8-9534-4ccc-85b2-d58e96de6e31', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7feb403c-5fd6-4014-a98e-2b3cd68b272b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:08 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Volume volume-5cec3fd8-9534-4ccc-85b2-d58e96de6e31 (5cec3fd8-9534-4ccc-85b2-d58e96de6e31): created successfully Feb 27 02:10:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7feb403c-5fd6-4014-a98e-2b3cd68b272b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Flow 'volume_create_manager' (b6c012c2-0c52-445b-bae5-16376213c658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:08 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b6eab522-f005-4071-9a6c-f1c1637e5f6b tempest-VolumesGetTest-84263323 None] Created volume successfully. Feb 27 02:10:09 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] Acquiring lock "cinder-5cec3fd8-9534-4ccc-85b2-d58e96de6e31-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:09 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] Lock "cinder-5cec3fd8-9534-4ccc-85b2-d58e96de6e31-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:09 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] Acquiring lock "cinder-quobyte-5cec3fd8-9534-4ccc-85b2-d58e96de6e31" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:09 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] Lock "cinder-quobyte-5cec3fd8-9534-4ccc-85b2-d58e96de6e31" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:09 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e1e4a4-6dd3-4702-a895-73ef8d9b87d2]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5cec3fd8-9534-4ccc-85b2-d58e96de6e31 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:09 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5cec3fd8-9534-4ccc-85b2-d58e96de6e31 Feb 27 02:10:09 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:09 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5cec3fd8-9534-4ccc-85b2-d58e96de6e31" returned: 0 in 0.528s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5cec3fd8-9534-4ccc-85b2-d58e96de6e31 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:09 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5cec3fd8-9534-4ccc-85b2-d58e96de6e31 Feb 27 02:10:09 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:10 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5cec3fd8-9534-4ccc-85b2-d58e96de6e31" returned: 0 in 0.473s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:10 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] Lock "cinder-quobyte-5cec3fd8-9534-4ccc-85b2-d58e96de6e31" released by "delete_volume" :: held 1.032s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:10 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] Created reservations ['8652a01c-9f3f-4fa2-ae2a-77660f1c9fd8', '007d92a7-5e2b-40c5-8b5d-33f9d55dcbf0', '2830b266-cae1-41a0-a1f4-480dc7ec037d', '32b22b88-3f6c-4d58-83a7-a61cd2e78262'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:10 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:10 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:10 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:10:10 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:10 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.443s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:10 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:10 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] Deleted volume successfully. Feb 27 02:10:10 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9567e286-19c6-4fa2-ad0a-aa41e54b4f7c tempest-VolumesGetTest-84263323 None] Lock "cinder-5cec3fd8-9534-4ccc-85b2-d58e96de6e31-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:11 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] Acquiring lock "cinder-552d0c28-0815-428a-b009-1746e5ecf931-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:11 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] Lock "cinder-552d0c28-0815-428a-b009-1746e5ecf931-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:11 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] Acquiring lock "cinder-quobyte-552d0c28-0815-428a-b009-1746e5ecf931" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:11 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] Lock "cinder-quobyte-552d0c28-0815-428a-b009-1746e5ecf931" acquired by "delete_volume" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:11 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b082b8b0-1202-46f2-ad87-b21efd0d137a]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-552d0c28-0815-428a-b009-1746e5ecf931 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:11 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-552d0c28-0815-428a-b009-1746e5ecf931 Feb 27 02:10:11 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:11 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-552d0c28-0815-428a-b009-1746e5ecf931" returned: 0 in 0.533s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-552d0c28-0815-428a-b009-1746e5ecf931 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:11 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-552d0c28-0815-428a-b009-1746e5ecf931 Feb 27 02:10:11 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:12 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-552d0c28-0815-428a-b009-1746e5ecf931" returned: 0 in 0.500s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:12 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] Lock "cinder-quobyte-552d0c28-0815-428a-b009-1746e5ecf931" released by "delete_volume" :: held 1.066s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:12 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] Created reservations ['2e808103-d383-4c3f-b4f5-28931d7dc46a', 'f050a51c-d048-44c6-9db9-b5374b0f17b7', '9f8b219f-9f11-49d1-a058-6a3bb6e41acd', '868400f6-9902-4394-9292-f3297ad1e473'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:12 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:10:12 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:13 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.502s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:13 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:13 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] Deleted volume successfully. Feb 27 02:10:13 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b3fb649d-edb7-4240-9e74-6c58ccfc3198 tempest-VolumesGetTest-84263323 None] Lock "cinder-552d0c28-0815-428a-b009-1746e5ecf931-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:13 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] Acquiring lock "cinder-2d738987-8383-4703-bb0b-004662db2482-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:13 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] Lock "cinder-2d738987-8383-4703-bb0b-004662db2482-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:13 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] Acquiring lock "cinder-quobyte-2d738987-8383-4703-bb0b-004662db2482" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:13 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] Lock "cinder-quobyte-2d738987-8383-4703-bb0b-004662db2482" acquired by "delete_volume" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:13 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbef1a7-ea4f-4479-a8bc-2c35fad34e0d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:13 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 Feb 27 02:10:13 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:14 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482" returned: 0 in 0.512s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:14 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482 Feb 27 02:10:14 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:14 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2d738987-8383-4703-bb0b-004662db2482" returned: 0 in 0.431s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] Lock "cinder-quobyte-2d738987-8383-4703-bb0b-004662db2482" released by "delete_volume" :: held 0.976s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:14 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] Created reservations ['16a4c47d-9dd2-4274-af4f-4290a8e244fe', 'bc2f8e6b-39b6-4528-b005-3b6b5c09f1e5', 'fcdb0e1f-3899-4c2b-ae39-2ddf32d3e7f8', '33801ec6-a8d8-4e7c-b867-639f6f6c1b0a'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:14 devstack sudo[90054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:10:14 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:15 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.493s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:15 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] Deleted volume successfully. Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ea8dfa37-c5a8-4e0c-9b15-3b9dd87ec242 tempest-VolumesGetTest-84263323 None] Lock "cinder-2d738987-8383-4703-bb0b-004662db2482-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Flow 'volume_create_manager' (3fb1220b-d42e-43c1-8540-8176deeda92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3bd5d28-c91c-4bbd-b471-d0a22c1b099e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3bd5d28-c91c-4bbd-b471-d0a22c1b099e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-933364866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e64b851-d958-412d-bf66-a9f2c98df701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc66f096c4d9405993d6e1af52104b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:16Z,use_quota=True,user_id='fc2799a7a8d04a27a52ac8183695e8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d58733-ff17-436e-b552-45c6f44e292a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d58733-ff17-436e-b552-45c6f44e292a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c97894-6db3-40ce-b7f7-cee3c794e919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c97894-6db3-40ce-b7f7-cee3c794e919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e64b851-d958-412d-bf66-a9f2c98df701', 'volume_name': 'volume-0e64b851-d958-412d-bf66-a9f2c98df701', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd620e7-7983-4fc1-b477-e4e59ef87d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd620e7-7983-4fc1-b477-e4e59ef87d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280a2eae-e951-48b3-9597-4565beee8bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:15 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Volume 0e64b851-d958-412d-bf66-a9f2c98df701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e64b851-d958-412d-bf66-a9f2c98df701', 'volume_size': 1} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-933364866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e64b851-d958-412d-bf66-a9f2c98df701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc66f096c4d9405993d6e1af52104b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:16Z,use_quota=True,user_id='fc2799a7a8d04a27a52ac8183695e8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Creating volume 0e64b851-d958-412d-bf66-a9f2c98df701 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:15 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:10:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:15 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 1073741824 Feb 27 02:10:15 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Flow 'volume_create_manager' (bcba36ce-9d6b-4310-9956-edfdf537c4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640efb7a-f485-4e89-b535-c984d94e9b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640efb7a-f485-4e89-b535-c984d94e9b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-156033676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03218e3c-f3fa-46c6-92ff-bc947db03109,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='140c6f28a1e841d09acae73b7f1b1fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:16Z,use_quota=True,user_id='d96443f2bab743369770199d778d14df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c00632c-f2ed-470e-a2b7-53362b839f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c00632c-f2ed-470e-a2b7-53362b839f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba54a3f0-c7f7-4579-9306-01bcebb4cb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG cinder.image.glance [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Creating Keystone auth plugin from conf {{(pid=83231) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:10:16 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 1073741824" returned: 0 in 0.552s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:16 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 Feb 27 02:10:16 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba54a3f0-c7f7-4579-9306-01bcebb4cb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '03218e3c-f3fa-46c6-92ff-bc947db03109', 'volume_name': 'volume-03218e3c-f3fa-46c6-92ff-bc947db03109', 'volume_size': 1, 'image_id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '264ceeea24524ec49624b8e3d37f06d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7cf8ed6-202a-4958-a4d1-82ece60f0191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7cf8ed6-202a-4958-a4d1-82ece60f0191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288106f2-1c9c-4a03-934c-f0404b5e109c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:16 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Volume 03218e3c-f3fa-46c6-92ff-bc947db03109: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-03218e3c-f3fa-46c6-92ff-bc947db03109', 'volume_size': 1, 'image_id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '264ceeea24524ec49624b8e3d37f06d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Trying to clone 03218e3c-f3fa-46c6-92ff-bc947db03109 from image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}]). {{(pid=83231) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_db3cpw_ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83231) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:10:16 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb528220-127a-46e7-b674-a4e2e377b186]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_db3cpw_ldevstack@QuobyteHD {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:16 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_db3cpw_ldevstack@QuobyteHD Feb 27 02:10:16 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:16 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701" returned: 0 in 0.451s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280a2eae-e951-48b3-9597-4565beee8bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e64b851-d958-412d-bf66-a9f2c98df701', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292c03ac-8570-414b-9623-b5dce6863cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:16 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Volume volume-0e64b851-d958-412d-bf66-a9f2c98df701 (0e64b851-d958-412d-bf66-a9f2c98df701): created successfully Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292c03ac-8570-414b-9623-b5dce6863cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Flow 'volume_create_manager' (3fb1220b-d42e-43c1-8540-8176deeda92a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:16 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-e8c78fe3-fd84-497c-9a32-3ee124c9b114 tempest-SnapshotDependencyTests-1849964264 None] Created volume successfully. Feb 27 02:10:17 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_db3cpw_ldevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:17 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Temporary image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 is fetched for user d96443f2bab743369770199d778d14df. {{(pid=83231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:10:17 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7381d0-3e57-4b32-9e1c-ed21dd7a8fb2]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_db3cpw_ldevstack@QuobyteHD {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:17 devstack sudo[90071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_db3cpw_ldevstack@QuobyteHD Feb 27 02:10:17 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:17 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_db3cpw_ldevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:17 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-156033676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03218e3c-f3fa-46c6-92ff-bc947db03109,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='140c6f28a1e841d09acae73b7f1b1fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:16Z,use_quota=True,user_id='d96443f2bab743369770199d778d14df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:17 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Creating volume 03218e3c-f3fa-46c6-92ff-bc947db03109 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:17 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:17 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:17 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:17 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:10:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:17 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 1073741824 Feb 27 02:10:17 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d92c1816-ccb6-42b9-8b28-96a7dd94435d tempest-SnapshotDependencyTests-1849964264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:18 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 1073741824" returned: 0 in 0.575s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:18 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 Feb 27 02:10:18 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:18 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109" returned: 0 in 0.394s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d92c1816-ccb6-42b9-8b28-96a7dd94435d tempest-SnapshotDependencyTests-1849964264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.613s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-d92c1816-ccb6-42b9-8b28-96a7dd94435d tempest-SnapshotDependencyTests-1849964264 None] Creating offline snapshot 4485dde7-e7ea-405a-99a0-c646082c9e26 of volume 0e64b851-d958-412d-bf66-a9f2c98df701 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:10:18 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f733a1-1236-46ae-8749-31ae8f6eff30]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d92c1816-ccb6-42b9-8b28-96a7dd94435d tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:18 devstack cinder-volume[83231]: DEBUG cinder.volume.volume_utils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Attempting download of e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}])) to volume 03218e3c-f3fa-46c6-92ff-bc947db03109. {{(pid=83231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:10:18 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4084bcaa-532d-4e92-b47c-c87bcc46d56f]: (4, 'raw') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_fce6059g {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:18 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 Feb 27 02:10:18 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:18 devstack sudo[90085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_fce6059g Feb 27 02:10:18 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:19 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d92c1816-ccb6-42b9-8b28-96a7dd94435d tempest-SnapshotDependencyTests-1849964264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701" returned: 0 in 0.477s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d92c1816-ccb6-42b9-8b28-96a7dd94435d tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:19 devstack sudo[90093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26 1G Feb 27 02:10:19 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:19 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_fce6059g" returned: 0 in 0.472s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_fce6059g {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:19 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_fce6059g Feb 27 02:10:19 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:19 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d92c1816-ccb6-42b9-8b28-96a7dd94435d tempest-SnapshotDependencyTests-1849964264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26 1G" returned: 0 in 0.511s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d92c1816-ccb6-42b9-8b28-96a7dd94435d tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e64b851-d958-412d-bf66-a9f2c98df701 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:19 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e64b851-d958-412d-bf66-a9f2c98df701 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26 Feb 27 02:10:19 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:19 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_fce6059g" returned: 1 in 0.511s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_fce6059g' failed. Not Retrying. {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:10:19 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a55e8bc-2f1c-4d45-b3de-bdf2109e7208]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_db3cpw_ldevstack@QuobyteHD {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:19 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_db3cpw_ldevstack@QuobyteHD Feb 27 02:10:19 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:20 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d92c1816-ccb6-42b9-8b28-96a7dd94435d tempest-SnapshotDependencyTests-1849964264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e64b851-d958-412d-bf66-a9f2c98df701 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26" returned: 0 in 0.513s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:20 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-d92c1816-ccb6-42b9-8b28-96a7dd94435d tempest-SnapshotDependencyTests-1849964264 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26 is being set with open permissions: ugo+rw Feb 27 02:10:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d92c1816-ccb6-42b9-8b28-96a7dd94435d tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:20 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26 Feb 27 02:10:20 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:20 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_db3cpw_ldevstack@QuobyteHD" returned: 0 in 0.519s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:20 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 was qcow2, converting to raw {{(pid=83231) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:10:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_db3cpw_ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:20 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_db3cpw_ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 Feb 27 02:10:20 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:20 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d92c1816-ccb6-42b9-8b28-96a7dd94435d tempest-SnapshotDependencyTests-1849964264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26" returned: 0 in 0.516s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d92c1816-ccb6-42b9-8b28-96a7dd94435d tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:20 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.info Feb 27 02:10:20 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:21 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d92c1816-ccb6-42b9-8b28-96a7dd94435d tempest-SnapshotDependencyTests-1849964264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.info" returned: 0 in 0.500s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:21 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-d92c1816-ccb6-42b9-8b28-96a7dd94435d tempest-SnapshotDependencyTests-1849964264 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.info is being set with open permissions: ugo+rw Feb 27 02:10:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d92c1816-ccb6-42b9-8b28-96a7dd94435d tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:21 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.info Feb 27 02:10:21 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:21 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_db3cpw_ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109" returned: 0 in 1.097s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:21 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e784d5a1-d43c-4d9d-a77d-2d0ea36426c3_db3cpw_ldevstack@QuobyteHD, size 112.00 MB, duration 1.10 sec, destination /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 {{(pid=83231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:10:21 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Converted 112.00 MB image at 101.94 MB/s Feb 27 02:10:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:21 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 1G Feb 27 02:10:21 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:21 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d92c1816-ccb6-42b9-8b28-96a7dd94435d tempest-SnapshotDependencyTests-1849964264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.info" returned: 0 in 0.452s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d92c1816-ccb6-42b9-8b28-96a7dd94435d tempest-SnapshotDependencyTests-1849964264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.036s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:21 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-d92c1816-ccb6-42b9-8b28-96a7dd94435d tempest-SnapshotDependencyTests-1849964264 None] Create snapshot completed successfully Feb 27 02:10:21 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 1G" returned: 0 in 0.452s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:21 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a81c21-b33a-4c11-ba1b-2ce4121d766c]: (4, 'raw') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:21 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 Feb 27 02:10:21 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:22 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109" returned: 0 in 0.488s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:22 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 Feb 27 02:10:22 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Flow 'volume_create_manager' (70f0b9c3-4c91-429b-95bd-621d41d67f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff67653-0fa1-42a1-912e-8131f127d0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff67653-0fa1-42a1-912e-8131f127d0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1d1054-0a4b-420f-aa7a-2c23ee9df004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc66f096c4d9405993d6e1af52104b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4485dde7-e7ea-405a-99a0-c646082c9e26,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:22Z,use_quota=True,user_id='fc2799a7a8d04a27a52ac8183695e8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277e086e-9bdf-4ada-9324-125c87fd9749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277e086e-9bdf-4ada-9324-125c87fd9749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6e6d12-0c77-44ce-a49f-75e774c3bd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6e6d12-0c77-44ce-a49f-75e774c3bd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2e1d1054-0a4b-420f-aa7a-2c23ee9df004', 'volume_name': 'volume-2e1d1054-0a4b-420f-aa7a-2c23ee9df004', 'volume_size': 1, 'snapshot_id': '4485dde7-e7ea-405a-99a0-c646082c9e26'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cf07de-146f-4e2a-b22a-dccecc853d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cf07de-146f-4e2a-b22a-dccecc853d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b299805-4b55-4806-843a-18886295767f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:22 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Volume 2e1d1054-0a4b-420f-aa7a-2c23ee9df004: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2e1d1054-0a4b-420f-aa7a-2c23ee9df004', 'volume_size': 1, 'snapshot_id': '4485dde7-e7ea-405a-99a0-c646082c9e26'} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Acquiring lock "cinder-quobyte-4485dde7-e7ea-405a-99a0-c646082c9e26-2e1d1054-0a4b-420f-aa7a-2c23ee9df004" by "_create_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Lock "cinder-quobyte-4485dde7-e7ea-405a-99a0-c646082c9e26-2e1d1054-0a4b-420f-aa7a-2c23ee9df004" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Creating volume 2e1d1054-0a4b-420f-aa7a-2c23ee9df004 from snapshot 4485dde7-e7ea-405a-99a0-c646082c9e26 {{(pid=83231) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Acquiring lock "cinder-quobyte-2e1d1054-0a4b-420f-aa7a-2c23ee9df004" by "_copy_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Lock "cinder-quobyte-2e1d1054-0a4b-420f-aa7a-2c23ee9df004" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] snapshot: 4485dde7-e7ea-405a-99a0-c646082c9e26, volume: 2e1d1054-0a4b-420f-aa7a-2c23ee9df004, {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1120fb-c3a1-45c5-8ae4-a9ab979cfd88]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:22 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26 Feb 27 02:10:22 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:22 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109" returned: 1 in 0.533s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109' failed. Not Retrying. {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.volume_utils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Downloaded image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}])) to volume 03218e3c-f3fa-46c6-92ff-bc947db03109 successfully. {{(pid=83231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Temporary image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 for user d96443f2bab743369770199d778d14df is deleted. {{(pid=83231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.volume_utils [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Marking volume 03218e3c-f3fa-46c6-92ff-bc947db03109 as bootable. {{(pid=83231) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Copying metadata from image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 to 03218e3c-f3fa-46c6-92ff-bc947db03109. {{(pid=83231) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Creating volume glance metadata for volume 03218e3c-f3fa-46c6-92ff-bc947db03109 backed by image e784d5a1-d43c-4d9d-a77d-2d0ea36426c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83231) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288106f2-1c9c-4a03-934c-f0404b5e109c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03218e3c-f3fa-46c6-92ff-bc947db03109', 'volume_size': 1, 'image_id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '264ceeea24524ec49624b8e3d37f06d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e784d5a1-d43c-4d9d-a77d-2d0ea36426c3', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e784d5a1-d43c-4d9d-a77d-2d0ea36426c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b75723c-cdfc-410c-8f58-db3b365f3c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:22 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Volume volume-03218e3c-f3fa-46c6-92ff-bc947db03109 (03218e3c-f3fa-46c6-92ff-bc947db03109): created successfully Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b75723c-cdfc-410c-8f58-db3b365f3c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:22 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Flow 'volume_create_manager' (bcba36ce-9d6b-4310-9956-edfdf537c4db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:22 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-a76ae4ed-289a-4398-ad7d-8b14b033cafa tempest-VolumesGetTest-84263323 None] Created volume successfully. Feb 27 02:10:23 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26" returned: 0 in 0.502s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e64b851-d958-412d-bf66-a9f2c98df701(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:10:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:10:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Creating direct copy from snapshot {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:10:23 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f68544d-cfe8-4996-ba1d-5d05755944ea]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:23 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 Feb 27 02:10:23 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:23 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701" returned: 0 in 0.599s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:23 devstack cinder-volume[83231]: DEBUG cinder.utils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Path /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2e1d1054-0a4b-420f-aa7a-2c23ee9df004 not found in is_blk_device check {{(pid=83231) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:10:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2e1d1054-0a4b-420f-aa7a-2c23ee9df004 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:23 devstack sudo[90197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2e1d1054-0a4b-420f-aa7a-2c23ee9df004 Feb 27 02:10:23 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:24 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:24 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Flow 'volume_create_manager' (9baff68b-70af-4213-869a-fba446111de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:24 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7d44d0-3ec7-4f98-a667-f40ed3cb44b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:24 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7d44d0-3ec7-4f98-a667-f40ed3cb44b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-743339824',display_name='tempest-VolumesGetTest-Volume-484650827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5acc302-e4bd-4297-80c7-c6305990e89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140c6f28a1e841d09acae73b7f1b1fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:24Z,use_quota=True,user_id='d96443f2bab743369770199d778d14df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:24 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269cae0a-d605-46c2-b755-6d93d749fcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:24 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269cae0a-d605-46c2-b755-6d93d749fcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:24 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bec5093-e8a5-4c55-b19a-b8a93b448ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:24 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bec5093-e8a5-4c55-b19a-b8a93b448ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5acc302-e4bd-4297-80c7-c6305990e89b', 'volume_name': 'volume-e5acc302-e4bd-4297-80c7-c6305990e89b', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:24 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7359db-8a47-47fe-a5cd-8c8b2c19c131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:24 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7359db-8a47-47fe-a5cd-8c8b2c19c131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:24 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf56abb-aced-479a-8104-8d53ded0331f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:24 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Volume e5acc302-e4bd-4297-80c7-c6305990e89b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5acc302-e4bd-4297-80c7-c6305990e89b', 'volume_size': 1} Feb 27 02:10:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:25 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2e1d1054-0a4b-420f-aa7a-2c23ee9df004" returned: 0 in 2.086s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:25 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0179f288-4291-4c72-a418-397a2c7a54bb]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:25 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 Feb 27 02:10:25 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:26 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701" returned: 0 in 0.604s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Image conversion details: src /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2e1d1054-0a4b-420f-aa7a-2c23ee9df004 {{(pid=83231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:10:26 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Converted 1024.00 MB image at 490.46 MB/s Feb 27 02:10:26 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2e1d1054-0a4b-420f-aa7a-2c23ee9df004 is being set with open permissions: ugo+rw Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2e1d1054-0a4b-420f-aa7a-2c23ee9df004 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:26 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2e1d1054-0a4b-420f-aa7a-2c23ee9df004 Feb 27 02:10:26 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:26 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2e1d1054-0a4b-420f-aa7a-2c23ee9df004" returned: 0 in 0.420s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Lock "cinder-quobyte-2e1d1054-0a4b-420f-aa7a-2c23ee9df004" released by "_copy_volume_from_snapshot" :: held 4.266s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Lock "cinder-quobyte-4485dde7-e7ea-405a-99a0-c646082c9e26-2e1d1054-0a4b-420f-aa7a-2c23ee9df004" released by "_create_volume_from_snapshot" :: held 4.281s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.291s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.454s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-743339824',display_name='tempest-VolumesGetTest-Volume-484650827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5acc302-e4bd-4297-80c7-c6305990e89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140c6f28a1e841d09acae73b7f1b1fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:24Z,use_quota=True,user_id='d96443f2bab743369770199d778d14df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Creating volume e5acc302-e4bd-4297-80c7-c6305990e89b {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:26 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e5acc302-e4bd-4297-80c7-c6305990e89b 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:26 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e5acc302-e4bd-4297-80c7-c6305990e89b 1073741824 Feb 27 02:10:26 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b299805-4b55-4806-843a-18886295767f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e1d1054-0a4b-420f-aa7a-2c23ee9df004', 'volume_size': 1, 'snapshot_id': '4485dde7-e7ea-405a-99a0-c646082c9e26'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ea1fb9-d287-4bc2-97d5-d840bd8c9ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:26 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Volume volume-2e1d1054-0a4b-420f-aa7a-2c23ee9df004 (2e1d1054-0a4b-420f-aa7a-2c23ee9df004): created successfully Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ea1fb9-d287-4bc2-97d5-d840bd8c9ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Flow 'volume_create_manager' (70f0b9c3-4c91-429b-95bd-621d41d67f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:26 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-178421ff-5add-4eaf-b7cf-64e0bb357229 tempest-SnapshotDependencyTests-1849964264 None] Created volume successfully. Feb 27 02:10:27 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e5acc302-e4bd-4297-80c7-c6305990e89b 1073741824" returned: 0 in 0.497s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e5acc302-e4bd-4297-80c7-c6305990e89b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:27 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e5acc302-e4bd-4297-80c7-c6305990e89b Feb 27 02:10:27 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:27 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e5acc302-e4bd-4297-80c7-c6305990e89b" returned: 0 in 0.385s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:27 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:27 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf56abb-aced-479a-8104-8d53ded0331f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5acc302-e4bd-4297-80c7-c6305990e89b', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:27 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdfb19d-04d1-48f8-a6a1-3363c9d2ffd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:27 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Volume volume-e5acc302-e4bd-4297-80c7-c6305990e89b (e5acc302-e4bd-4297-80c7-c6305990e89b): created successfully Feb 27 02:10:27 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdfb19d-04d1-48f8-a6a1-3363c9d2ffd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:27 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Flow 'volume_create_manager' (9baff68b-70af-4213-869a-fba446111de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:27 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-1aa5fdc9-6c2b-469b-b5d2-587f8e3ebd41 tempest-VolumesGetTest-84263323 None] Created volume successfully. Feb 27 02:10:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] Acquiring lock "cinder-4485dde7-e7ea-405a-99a0-c646082c9e26-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] Lock "cinder-4485dde7-e7ea-405a-99a0-c646082c9e26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] Acquiring lock "cinder-quobyte-0e64b851-d958-412d-bf66-a9f2c98df701" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] Lock "cinder-quobyte-0e64b851-d958-412d-bf66-a9f2c98df701" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] Acquiring lock "cinder-quobyte-4485dde7-e7ea-405a-99a0-c646082c9e26" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] Lock "cinder-quobyte-4485dde7-e7ea-405a-99a0-c646082c9e26" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:27 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] Deleting offline snapshot 4485dde7-e7ea-405a-99a0-c646082c9e26 of volume 0e64b851-d958-412d-bf66-a9f2c98df701 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:10:27 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] snapshot_file for this snap is: volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:10:27 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e289782-f60f-4fda-9797-4b77d205163d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:28 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26 Feb 27 02:10:28 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:28 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26" returned: 0 in 0.528s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:28 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e64b851-d958-412d-bf66-a9f2c98df701(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:10:28 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b1a733-f386-48c7-993a-ec4b414c59cc]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:28 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 Feb 27 02:10:28 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] Acquiring lock "cinder-e5acc302-e4bd-4297-80c7-c6305990e89b-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] Lock "cinder-e5acc302-e4bd-4297-80c7-c6305990e89b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] Acquiring lock "cinder-quobyte-e5acc302-e4bd-4297-80c7-c6305990e89b" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] Lock "cinder-quobyte-e5acc302-e4bd-4297-80c7-c6305990e89b" acquired by "delete_volume" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:28 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8492c5fa-3bf6-499b-b7e7-14eb2f8464ca]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e5acc302-e4bd-4297-80c7-c6305990e89b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:28 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e5acc302-e4bd-4297-80c7-c6305990e89b Feb 27 02:10:28 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:29 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701" returned: 0 in 0.550s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:29 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26 Feb 27 02:10:29 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:29 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e5acc302-e4bd-4297-80c7-c6305990e89b" returned: 0 in 0.494s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e5acc302-e4bd-4297-80c7-c6305990e89b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:29 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e5acc302-e4bd-4297-80c7-c6305990e89b Feb 27 02:10:29 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:29 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26" returned: 0 in 0.468s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:29 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26 Feb 27 02:10:29 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:29 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e5acc302-e4bd-4297-80c7-c6305990e89b" returned: 0 in 0.428s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] Lock "cinder-quobyte-e5acc302-e4bd-4297-80c7-c6305990e89b" released by "delete_volume" :: held 0.948s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:29 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] Created reservations ['9aa00fc5-cc06-46ee-9d38-2ebd94363fca', 'd5690fb0-7ed4-4d65-9636-db89ceb85ea2', '803f3573-d6ec-47c8-89f9-c949f6a35bb7', '28a61aa8-7446-4d63-93e3-37a90c642d96'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:29 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:10:29 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:30 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701.4485dde7-e7ea-405a-99a0-c646082c9e26" returned: 0 in 0.501s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] Lock "cinder-quobyte-4485dde7-e7ea-405a-99a0-c646082c9e26" released by "_delete_snapshot" :: held 2.111s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] Lock "cinder-quobyte-0e64b851-d958-412d-bf66-a9f2c98df701" released by "delete_snapshot" :: held 2.126s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:30 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] Created reservations ['339f16a7-19be-4127-b3cb-db041a5989b4', '6734011d-8dc7-4d15-93df-549f8235455c', 'dfbf7f6e-9338-4246-b9ca-89281c4d09bc', '03329a38-9e08-4028-82e2-76eb189ded72'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:30 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] Delete snapshot completed successfully. Feb 27 02:10:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9823baf7-9dc5-4710-8b17-55b2b0c7d6cf tempest-SnapshotDependencyTests-1849964264 None] Lock "cinder-4485dde7-e7ea-405a-99a0-c646082c9e26-delete_snapshot" released by "delete_snapshot" :: held 2.246s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:30 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.485s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:30 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:30 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] Deleted volume successfully. Feb 27 02:10:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d107cbe5-8ca9-4eb2-b5bd-ce3dc24aa191 tempest-VolumesGetTest-84263323 None] Lock "cinder-e5acc302-e4bd-4297-80c7-c6305990e89b-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] Acquiring lock "cinder-03218e3c-f3fa-46c6-92ff-bc947db03109-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] Lock "cinder-03218e3c-f3fa-46c6-92ff-bc947db03109-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] Acquiring lock "cinder-quobyte-03218e3c-f3fa-46c6-92ff-bc947db03109" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] Lock "cinder-quobyte-03218e3c-f3fa-46c6-92ff-bc947db03109" acquired by "delete_volume" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:30 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7aa9e3-fb95-40c1-a729-1d369548ece7]: (4, 'raw') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:31 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 Feb 27 02:10:31 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] Acquiring lock "cinder-0e64b851-d958-412d-bf66-a9f2c98df701-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] Lock "cinder-0e64b851-d958-412d-bf66-a9f2c98df701-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] Acquiring lock "cinder-quobyte-0e64b851-d958-412d-bf66-a9f2c98df701" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] Lock "cinder-quobyte-0e64b851-d958-412d-bf66-a9f2c98df701" acquired by "delete_volume" :: waited 0.007s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:31 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[800735e6-5fd6-4926-9034-d25852e77c93]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:31 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 Feb 27 02:10:31 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:31 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109" returned: 0 in 0.533s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:31 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 Feb 27 02:10:31 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:31 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701" returned: 0 in 0.517s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:31 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701 Feb 27 02:10:31 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:31 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109" returned: 1 in 0.462s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109' failed. Not Retrying. {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:10:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:31 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109 Feb 27 02:10:31 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:32 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0e64b851-d958-412d-bf66-a9f2c98df701" returned: 0 in 0.429s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] Lock "cinder-quobyte-0e64b851-d958-412d-bf66-a9f2c98df701" released by "delete_volume" :: held 0.979s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] Created reservations ['dba6784c-4267-40e3-b12f-6e2afa306f8d', '4488103d-e386-4b55-818d-ad9dba8a9ea3', 'fc4fe60c-27c2-4cff-b703-7387565ccbd7', '227757e7-38bd-43b2-88fe-f1aa81308a46'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:32 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:10:32 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:32 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-03218e3c-f3fa-46c6-92ff-bc947db03109" returned: 0 in 0.452s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] Lock "cinder-quobyte-03218e3c-f3fa-46c6-92ff-bc947db03109" released by "delete_volume" :: held 1.498s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] Created reservations ['1369c4a6-bfac-4c64-94a7-47da69c9b8f9', '0f32b785-873f-4d71-abf2-d8ab531b75b1', '86ec6b66-6551-4862-82c1-312979187387', '0123cbb6-c748-4c8e-84ac-c99a97e94b80'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:32 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:10:32 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:32 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.465s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:32 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] Deleted volume successfully. Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6d97ff71-3150-44e9-9706-dd2ed468ab48 tempest-SnapshotDependencyTests-1849964264 None] Lock "cinder-0e64b851-d958-412d-bf66-a9f2c98df701-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:32 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.431s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:32 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] Deleted volume successfully. Feb 27 02:10:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8fd4bac0-a974-4721-a553-2197d4c306bb tempest-VolumesGetTest-84263323 None] Lock "cinder-03218e3c-f3fa-46c6-92ff-bc947db03109-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] Acquiring lock "cinder-2e1d1054-0a4b-420f-aa7a-2c23ee9df004-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] Lock "cinder-2e1d1054-0a4b-420f-aa7a-2c23ee9df004-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] Acquiring lock "cinder-quobyte-2e1d1054-0a4b-420f-aa7a-2c23ee9df004" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] Lock "cinder-quobyte-2e1d1054-0a4b-420f-aa7a-2c23ee9df004" acquired by "delete_volume" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:33 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5777fc2a-700a-4f86-b854-2e1db0dec99d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2e1d1054-0a4b-420f-aa7a-2c23ee9df004 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:33 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2e1d1054-0a4b-420f-aa7a-2c23ee9df004 Feb 27 02:10:33 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:34 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2e1d1054-0a4b-420f-aa7a-2c23ee9df004" returned: 0 in 0.618s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2e1d1054-0a4b-420f-aa7a-2c23ee9df004 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:34 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2e1d1054-0a4b-420f-aa7a-2c23ee9df004 Feb 27 02:10:34 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:34 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-2e1d1054-0a4b-420f-aa7a-2c23ee9df004" returned: 0 in 0.491s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] Lock "cinder-quobyte-2e1d1054-0a4b-420f-aa7a-2c23ee9df004" released by "delete_volume" :: held 1.137s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:34 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] Created reservations ['888c3a9a-daf2-4f8d-b28e-f3d4f107602a', 'ffc9f735-367b-4fc4-9d53-d4f15571d7f4', '0f21ad8b-f271-4d4f-8828-2975518d2b1e', '28098e61-bd4f-41fe-999b-ee02ee1429eb'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:35 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:10:35 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:35 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.433s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:35 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:35 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] Deleted volume successfully. Feb 27 02:10:35 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-10a4b9cc-6e0b-4aa5-aeb9-65a461697e74 tempest-SnapshotDependencyTests-1849964264 None] Lock "cinder-2e1d1054-0a4b-420f-aa7a-2c23ee9df004-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Flow 'volume_create_manager' (740c5753-ff33-4026-becb-5e8787e141ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d423aef-dbba-4eb8-b980-31a6456a1121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d423aef-dbba-4eb8-b980-31a6456a1121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1616462296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db18315e-8c6b-4ccf-a904-155c5726f284,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1e82e69ea904899929b89a26477ae9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:40Z,use_quota=True,user_id='82c65929a5ec479eb34d1d5d02070b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1edbb797-f368-4271-9d37-c091463182fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1edbb797-f368-4271-9d37-c091463182fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022e5b9b-2aba-4b60-85ef-21e74f437bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022e5b9b-2aba-4b60-85ef-21e74f437bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db18315e-8c6b-4ccf-a904-155c5726f284', 'volume_name': 'volume-db18315e-8c6b-4ccf-a904-155c5726f284', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7887a715-c3d5-4e1f-a973-4ad04d0edd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7887a715-c3d5-4e1f-a973-4ad04d0edd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd47fc3-218e-4dd1-9c25-33f4c4171022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Volume db18315e-8c6b-4ccf-a904-155c5726f284: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db18315e-8c6b-4ccf-a904-155c5726f284', 'volume_size': 1} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1616462296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db18315e-8c6b-4ccf-a904-155c5726f284,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1e82e69ea904899929b89a26477ae9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:40Z,use_quota=True,user_id='82c65929a5ec479eb34d1d5d02070b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Creating volume db18315e-8c6b-4ccf-a904-155c5726f284 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:40 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:10:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-db18315e-8c6b-4ccf-a904-155c5726f284 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:40 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-db18315e-8c6b-4ccf-a904-155c5726f284 1073741824 Feb 27 02:10:40 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:41 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-db18315e-8c6b-4ccf-a904-155c5726f284 1073741824" returned: 0 in 0.539s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-db18315e-8c6b-4ccf-a904-155c5726f284 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:41 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-db18315e-8c6b-4ccf-a904-155c5726f284 Feb 27 02:10:41 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:41 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-db18315e-8c6b-4ccf-a904-155c5726f284" returned: 0 in 0.511s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd47fc3-218e-4dd1-9c25-33f4c4171022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db18315e-8c6b-4ccf-a904-155c5726f284', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86d6764-0998-4af5-88eb-b6f9c1c368a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:41 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Volume volume-db18315e-8c6b-4ccf-a904-155c5726f284 (db18315e-8c6b-4ccf-a904-155c5726f284): created successfully Feb 27 02:10:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86d6764-0998-4af5-88eb-b6f9c1c368a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Flow 'volume_create_manager' (740c5753-ff33-4026-becb-5e8787e141ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:41 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-da6466ba-3be3-4f19-bca0-c6b69d90f12d tempest-VolumesListTestJSON-667766814 None] Created volume successfully. Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:UPDATE=163,cinder:DELETE=16,cinder:SELECT=123,cinder:INSERT=47 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=112,cinder:UPDATE=167,cinder:DELETE=13,cinder:INSERT=44 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Flow 'volume_create_manager' (01a50dfe-7b14-4831-b2db-9053824081dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76d6767-3271-4a76-adb4-d91ab15a4b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76d6767-3271-4a76-adb4-d91ab15a4b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1674418195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b34ece-084d-4919-8983-9e399664e33b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1e82e69ea904899929b89a26477ae9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:43Z,use_quota=True,user_id='82c65929a5ec479eb34d1d5d02070b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd1f1c6f-f6b2-4f17-a1e9-5cdabf4b0b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd1f1c6f-f6b2-4f17-a1e9-5cdabf4b0b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad557b6d-9ba6-4f79-a1fb-265866f032ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad557b6d-9ba6-4f79-a1fb-265866f032ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8b34ece-084d-4919-8983-9e399664e33b', 'volume_name': 'volume-c8b34ece-084d-4919-8983-9e399664e33b', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef52dff8-1256-4234-82db-8538471a5bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef52dff8-1256-4234-82db-8538471a5bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb1062b-db72-41d0-a642-370f3334e816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:42 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Volume c8b34ece-084d-4919-8983-9e399664e33b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8b34ece-084d-4919-8983-9e399664e33b', 'volume_size': 1} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1674418195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b34ece-084d-4919-8983-9e399664e33b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1e82e69ea904899929b89a26477ae9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:43Z,use_quota=True,user_id='82c65929a5ec479eb34d1d5d02070b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Creating volume c8b34ece-084d-4919-8983-9e399664e33b {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:42 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:10:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c8b34ece-084d-4919-8983-9e399664e33b 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:42 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c8b34ece-084d-4919-8983-9e399664e33b 1073741824 Feb 27 02:10:42 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:43 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c8b34ece-084d-4919-8983-9e399664e33b 1073741824" returned: 0 in 0.523s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c8b34ece-084d-4919-8983-9e399664e33b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:43 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c8b34ece-084d-4919-8983-9e399664e33b Feb 27 02:10:43 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:44 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c8b34ece-084d-4919-8983-9e399664e33b" returned: 0 in 0.484s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:44 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb1062b-db72-41d0-a642-370f3334e816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8b34ece-084d-4919-8983-9e399664e33b', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd04736a-4700-4080-906c-af594cc15479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:44 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Volume volume-c8b34ece-084d-4919-8983-9e399664e33b (c8b34ece-084d-4919-8983-9e399664e33b): created successfully Feb 27 02:10:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd04736a-4700-4080-906c-af594cc15479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:44 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Flow 'volume_create_manager' (01a50dfe-7b14-4831-b2db-9053824081dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:44 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-17d79d5a-7580-4071-9fd3-b548fc912bff tempest-VolumesListTestJSON-667766814 None] Created volume successfully. Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Flow 'volume_create_manager' (7bb7d0c6-b7a1-4f76-9f70-f3c4c47a5abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aea6f67-b752-4886-a67d-474ec1dd9ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aea6f67-b752-4886-a67d-474ec1dd9ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-828567555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525437b0-c327-40cf-be68-849d84f74207,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1e82e69ea904899929b89a26477ae9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:45Z,use_quota=True,user_id='82c65929a5ec479eb34d1d5d02070b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (193f4103-5417-496b-90c5-b4fe47223626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (193f4103-5417-496b-90c5-b4fe47223626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248e88a5-9757-45d5-b4b7-7291663b6f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248e88a5-9757-45d5-b4b7-7291663b6f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '525437b0-c327-40cf-be68-849d84f74207', 'volume_name': 'volume-525437b0-c327-40cf-be68-849d84f74207', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83597c5-9261-4b27-8404-f859172273b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83597c5-9261-4b27-8404-f859172273b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38796e8f-1db0-4fc0-8b9b-edce7947d0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:45 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Volume 525437b0-c327-40cf-be68-849d84f74207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-525437b0-c327-40cf-be68-849d84f74207', 'volume_size': 1} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-828567555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525437b0-c327-40cf-be68-849d84f74207,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1e82e69ea904899929b89a26477ae9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:45Z,use_quota=True,user_id='82c65929a5ec479eb34d1d5d02070b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Creating volume 525437b0-c327-40cf-be68-849d84f74207 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:45 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:10:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-525437b0-c327-40cf-be68-849d84f74207 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:45 devstack sudo[90313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-525437b0-c327-40cf-be68-849d84f74207 1073741824 Feb 27 02:10:45 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:46 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-525437b0-c327-40cf-be68-849d84f74207 1073741824" returned: 0 in 0.653s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-525437b0-c327-40cf-be68-849d84f74207 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:46 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-525437b0-c327-40cf-be68-849d84f74207 Feb 27 02:10:46 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:46 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-525437b0-c327-40cf-be68-849d84f74207" returned: 0 in 0.482s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:46 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38796e8f-1db0-4fc0-8b9b-edce7947d0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-525437b0-c327-40cf-be68-849d84f74207', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:46 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3216fe-0f7b-499c-9380-4ce087b2ab12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:46 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Volume volume-525437b0-c327-40cf-be68-849d84f74207 (525437b0-c327-40cf-be68-849d84f74207): created successfully Feb 27 02:10:46 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3216fe-0f7b-499c-9380-4ce087b2ab12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:46 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Flow 'volume_create_manager' (7bb7d0c6-b7a1-4f76-9f70-f3c4c47a5abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:46 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-99169c37-2011-43ae-b939-232c18cf5332 tempest-VolumesListTestJSON-667766814 None] Created volume successfully. Feb 27 02:10:47 devstack cinder-volume[83231]: DEBUG oslo_service.periodic_task [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83231) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:10:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:47 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:10:47 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:47 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.433s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:47 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:49 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] Acquiring lock "cinder-525437b0-c327-40cf-be68-849d84f74207-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:49 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] Lock "cinder-525437b0-c327-40cf-be68-849d84f74207-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:49 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] Acquiring lock "cinder-quobyte-525437b0-c327-40cf-be68-849d84f74207" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:49 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] Lock "cinder-quobyte-525437b0-c327-40cf-be68-849d84f74207" acquired by "delete_volume" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:49 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[28781686-aaee-4c0f-8769-f54515124832]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-525437b0-c327-40cf-be68-849d84f74207 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:49 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-525437b0-c327-40cf-be68-849d84f74207 Feb 27 02:10:49 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:50 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-525437b0-c327-40cf-be68-849d84f74207" returned: 0 in 0.506s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-525437b0-c327-40cf-be68-849d84f74207 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:50 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-525437b0-c327-40cf-be68-849d84f74207 Feb 27 02:10:50 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:50 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-525437b0-c327-40cf-be68-849d84f74207" returned: 0 in 0.436s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] Lock "cinder-quobyte-525437b0-c327-40cf-be68-849d84f74207" released by "delete_volume" :: held 0.969s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:50 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] Created reservations ['d0e7cfbb-0142-4fdf-99be-056adcc973bf', '8ae52173-9395-4562-9424-d49e341fb10e', 'c994e834-2013-46c2-8272-d7d3f85c276d', 'a45b9447-1dcf-4d34-9d9a-430a6412f803'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:50 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:10:50 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] Acquiring lock "cinder-c8b34ece-084d-4919-8983-9e399664e33b-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] Lock "cinder-c8b34ece-084d-4919-8983-9e399664e33b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] Acquiring lock "cinder-quobyte-c8b34ece-084d-4919-8983-9e399664e33b" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] Lock "cinder-quobyte-c8b34ece-084d-4919-8983-9e399664e33b" acquired by "delete_volume" :: waited 0.006s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:50 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[252f0551-eb1c-4490-80ff-faa0c40309ec]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c8b34ece-084d-4919-8983-9e399664e33b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:50 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c8b34ece-084d-4919-8983-9e399664e33b Feb 27 02:10:50 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:51 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.433s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:51 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] Deleted volume successfully. Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1a5b6af9-7d60-4eb3-a872-fc730823961a tempest-VolumesListTestJSON-667766814 None] Lock "cinder-525437b0-c327-40cf-be68-849d84f74207-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:51 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c8b34ece-084d-4919-8983-9e399664e33b" returned: 0 in 0.526s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c8b34ece-084d-4919-8983-9e399664e33b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:51 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c8b34ece-084d-4919-8983-9e399664e33b Feb 27 02:10:51 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:51 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-c8b34ece-084d-4919-8983-9e399664e33b" returned: 0 in 0.410s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] Lock "cinder-quobyte-c8b34ece-084d-4919-8983-9e399664e33b" released by "delete_volume" :: held 0.959s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] Created reservations ['e56b2b58-9d65-4d5a-a502-3b45b6cc0784', '6afe0fa9-1164-40ff-88fb-3e3ad3b52180', 'fcdd4ab4-a48e-4849-829d-06cf956dd8c6', 'b48beb43-97b2-48cb-9fed-187059c73957'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:51 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:10:51 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] Acquiring lock "cinder-db18315e-8c6b-4ccf-a904-155c5726f284-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] Lock "cinder-db18315e-8c6b-4ccf-a904-155c5726f284-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] Acquiring lock "cinder-quobyte-db18315e-8c6b-4ccf-a904-155c5726f284" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] Lock "cinder-quobyte-db18315e-8c6b-4ccf-a904-155c5726f284" acquired by "delete_volume" :: waited 0.020s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c28f4d1-6a3a-47f8-92e0-8a123cee41e6]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-db18315e-8c6b-4ccf-a904-155c5726f284 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:52 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-db18315e-8c6b-4ccf-a904-155c5726f284 Feb 27 02:10:52 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:52 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.432s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:52 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:52 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] Deleted volume successfully. Feb 27 02:10:52 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-274c4da1-2a31-4cab-8b94-6231320a60da tempest-VolumesListTestJSON-667766814 None] Lock "cinder-c8b34ece-084d-4919-8983-9e399664e33b-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:52 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-db18315e-8c6b-4ccf-a904-155c5726f284" returned: 0 in 0.481s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-db18315e-8c6b-4ccf-a904-155c5726f284 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:52 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-db18315e-8c6b-4ccf-a904-155c5726f284 Feb 27 02:10:52 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:52 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-db18315e-8c6b-4ccf-a904-155c5726f284" returned: 0 in 0.413s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:52 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] Lock "cinder-quobyte-db18315e-8c6b-4ccf-a904-155c5726f284" released by "delete_volume" :: held 0.916s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:52 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] Created reservations ['350ac29e-587b-4f97-805f-008956336e9f', 'a8e50b59-95b5-4ce6-893e-b47235f84bb9', '177a986f-63a0-4a17-b99b-0f4ba76e448f', '84d3f3ff-7389-4c52-915d-6a72a3410d84'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:52 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:10:52 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:53 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.464s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:53 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:53 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] Deleted volume successfully. Feb 27 02:10:53 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-87211ad8-1a3f-46e0-807f-c8f6f137f72e tempest-VolumesListTestJSON-667766814 None] Lock "cinder-db18315e-8c6b-4ccf-a904-155c5726f284-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Flow 'volume_create_manager' (af824a7a-714a-4487-8699-e544c5513362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fe3c2d-cfd2-4701-b472-d35ca06a9d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fe3c2d-cfd2-4701-b472-d35ca06a9d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1449552119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e7bf42f978844ebb5d3b4978dbeef15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:55Z,use_quota=True,user_id='0ac5fa74e2794a4ea0dafb6846d3d6af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d45baf-0cde-4db5-827c-b79abdd9efeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d45baf-0cde-4db5-827c-b79abdd9efeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0079db4-cb62-417d-b7a7-f617df592dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0079db4-cb62-417d-b7a7-f617df592dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00', 'volume_name': 'volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d6f7754-e2f7-4e5e-91ee-0636e66985ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d6f7754-e2f7-4e5e-91ee-0636e66985ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef7e8cf-c276-45fc-94d2-0fb822738e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:54 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Volume 3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00', 'volume_size': 1} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1449552119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e7bf42f978844ebb5d3b4978dbeef15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:55Z,use_quota=True,user_id='0ac5fa74e2794a4ea0dafb6846d3d6af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Creating volume 3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:54 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:10:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:54 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 1073741824 Feb 27 02:10:54 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:55 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 1073741824" returned: 0 in 0.498s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:55 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 Feb 27 02:10:55 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:55 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00" returned: 0 in 0.404s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef7e8cf-c276-45fc-94d2-0fb822738e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fbab25-3c0a-40a9-ab3f-44ceb7511433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:55 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Volume volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 (3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00): created successfully Feb 27 02:10:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fbab25-3c0a-40a9-ab3f-44ceb7511433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:55 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Flow 'volume_create_manager' (af824a7a-714a-4487-8699-e544c5513362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:55 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-96eff20a-2e84-49e5-a255-f35120671f76 tempest-VolumeDependencyTests-463378128 None] Created volume successfully. Feb 27 02:10:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-29372843-c6d7-4d71-b0fb-14ea32e53f34 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-29372843-c6d7-4d71-b0fb-14ea32e53f34 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:57 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-29372843-c6d7-4d71-b0fb-14ea32e53f34 tempest-VolumeDependencyTests-463378128 None] Creating offline snapshot 830e5e33-618b-4a14-be2e-c1c17526f215 of volume 3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:10:57 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f3d9aa-2a7d-4dd5-8f7a-d1f6315678df]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-29372843-c6d7-4d71-b0fb-14ea32e53f34 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:57 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 Feb 27 02:10:57 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:57 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-29372843-c6d7-4d71-b0fb-14ea32e53f34 tempest-VolumeDependencyTests-463378128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00" returned: 0 in 0.560s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-29372843-c6d7-4d71-b0fb-14ea32e53f34 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:57 devstack sudo[90372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215 1G Feb 27 02:10:57 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:58 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-29372843-c6d7-4d71-b0fb-14ea32e53f34 tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215 1G" returned: 0 in 0.539s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-29372843-c6d7-4d71-b0fb-14ea32e53f34 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:58 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215 Feb 27 02:10:58 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:58 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-29372843-c6d7-4d71-b0fb-14ea32e53f34 tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215" returned: 0 in 0.446s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:58 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-29372843-c6d7-4d71-b0fb-14ea32e53f34 tempest-VolumeDependencyTests-463378128 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215 is being set with open permissions: ugo+rw Feb 27 02:10:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-29372843-c6d7-4d71-b0fb-14ea32e53f34 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:58 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215 Feb 27 02:10:58 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:59 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-29372843-c6d7-4d71-b0fb-14ea32e53f34 tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215" returned: 0 in 0.447s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-29372843-c6d7-4d71-b0fb-14ea32e53f34 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:59 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.info Feb 27 02:10:59 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:59 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-29372843-c6d7-4d71-b0fb-14ea32e53f34 tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.info" returned: 0 in 0.469s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:59 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-29372843-c6d7-4d71-b0fb-14ea32e53f34 tempest-VolumeDependencyTests-463378128 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.info is being set with open permissions: ugo+rw Feb 27 02:10:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-29372843-c6d7-4d71-b0fb-14ea32e53f34 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:59 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.info Feb 27 02:10:59 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:00 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-29372843-c6d7-4d71-b0fb-14ea32e53f34 tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.info" returned: 0 in 0.439s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-29372843-c6d7-4d71-b0fb-14ea32e53f34 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.963s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:00 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-29372843-c6d7-4d71-b0fb-14ea32e53f34 tempest-VolumeDependencyTests-463378128 None] Create snapshot completed successfully Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Flow 'volume_create_manager' (c1256879-1305-4994-ac4d-6abea6bc0ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3ab3e0-a3e2-4961-b59f-24e57f07a2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3ab3e0-a3e2-4961-b59f-24e57f07a2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-836701744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3552e35-1f06-4fa0-882c-45b287f54e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e7bf42f978844ebb5d3b4978dbeef15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=830e5e33-618b-4a14-be2e-c1c17526f215,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:00Z,use_quota=True,user_id='0ac5fa74e2794a4ea0dafb6846d3d6af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfca541-b342-4932-8848-5a1b396db10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfca541-b342-4932-8848-5a1b396db10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8d8cf2-1b3a-4283-bbb1-a6786c4b0d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8d8cf2-1b3a-4283-bbb1-a6786c4b0d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b3552e35-1f06-4fa0-882c-45b287f54e71', 'volume_name': 'volume-b3552e35-1f06-4fa0-882c-45b287f54e71', 'volume_size': 1, 'snapshot_id': '830e5e33-618b-4a14-be2e-c1c17526f215'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd6c211-b2fc-444e-8acc-056945830222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd6c211-b2fc-444e-8acc-056945830222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c5f919-c61a-4bfa-baa7-21592be756de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:00 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Volume b3552e35-1f06-4fa0-882c-45b287f54e71: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b3552e35-1f06-4fa0-882c-45b287f54e71', 'volume_size': 1, 'snapshot_id': '830e5e33-618b-4a14-be2e-c1c17526f215'} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "cinder-quobyte-830e5e33-618b-4a14-be2e-c1c17526f215-b3552e35-1f06-4fa0-882c-45b287f54e71" by "_create_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-830e5e33-618b-4a14-be2e-c1c17526f215-b3552e35-1f06-4fa0-882c-45b287f54e71" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Creating volume b3552e35-1f06-4fa0-882c-45b287f54e71 from snapshot 830e5e33-618b-4a14-be2e-c1c17526f215 {{(pid=83231) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "cinder-quobyte-b3552e35-1f06-4fa0-882c-45b287f54e71" by "_copy_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-b3552e35-1f06-4fa0-882c-45b287f54e71" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] snapshot: 830e5e33-618b-4a14-be2e-c1c17526f215, volume: b3552e35-1f06-4fa0-882c-45b287f54e71, {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[095b1a60-2ec7-40be-b19e-6c2816acd52d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:00 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215 Feb 27 02:11:00 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:01 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215" returned: 0 in 0.465s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:01 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:11:01 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:11:01 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Creating direct copy from snapshot {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:11:01 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c446b98-f8ca-426d-9eda-98caf5a8d99b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:01 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 Feb 27 02:11:01 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:01 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00" returned: 0 in 0.507s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:01 devstack cinder-volume[83231]: DEBUG cinder.utils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Path /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b3552e35-1f06-4fa0-882c-45b287f54e71 not found in is_blk_device check {{(pid=83231) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:11:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b3552e35-1f06-4fa0-882c-45b287f54e71 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:01 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b3552e35-1f06-4fa0-882c-45b287f54e71 Feb 27 02:11:01 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:03 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b3552e35-1f06-4fa0-882c-45b287f54e71" returned: 0 in 1.917s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:03 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df6db5e-dbfc-470c-853f-5b2bbc1549b7]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:03 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 Feb 27 02:11:03 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:04 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00" returned: 0 in 0.596s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Image conversion details: src /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00, size 1024.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b3552e35-1f06-4fa0-882c-45b287f54e71 {{(pid=83231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:11:04 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Converted 1024.00 MB image at 533.80 MB/s Feb 27 02:11:04 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b3552e35-1f06-4fa0-882c-45b287f54e71 is being set with open permissions: ugo+rw Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b3552e35-1f06-4fa0-882c-45b287f54e71 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:04 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b3552e35-1f06-4fa0-882c-45b287f54e71 Feb 27 02:11:04 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:04 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b3552e35-1f06-4fa0-882c-45b287f54e71" returned: 0 in 0.419s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-b3552e35-1f06-4fa0-882c-45b287f54e71" released by "_copy_volume_from_snapshot" :: held 3.965s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-830e5e33-618b-4a14-be2e-c1c17526f215-b3552e35-1f06-4fa0-882c-45b287f54e71" released by "_create_volume_from_snapshot" :: held 3.981s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.990s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c5f919-c61a-4bfa-baa7-21592be756de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3552e35-1f06-4fa0-882c-45b287f54e71', 'volume_size': 1, 'snapshot_id': '830e5e33-618b-4a14-be2e-c1c17526f215'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (959e9001-9231-47e6-ab03-82f02a36ad4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:04 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Volume volume-b3552e35-1f06-4fa0-882c-45b287f54e71 (b3552e35-1f06-4fa0-882c-45b287f54e71): created successfully Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (959e9001-9231-47e6-ab03-82f02a36ad4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Flow 'volume_create_manager' (c1256879-1305-4994-ac4d-6abea6bc0ba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:04 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-31edc630-8851-4873-99e7-cef140ce74d8 tempest-VolumeDependencyTests-463378128 None] Created volume successfully. Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "cinder-830e5e33-618b-4a14-be2e-c1c17526f215-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-830e5e33-618b-4a14-be2e-c1c17526f215-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "cinder-quobyte-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "cinder-quobyte-830e5e33-618b-4a14-be2e-c1c17526f215" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-830e5e33-618b-4a14-be2e-c1c17526f215" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] Deleting offline snapshot 830e5e33-618b-4a14-be2e-c1c17526f215 of volume 3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] snapshot_file for this snap is: volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e1a41f-b734-4174-a3e1-afbade658e10]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:05 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215 Feb 27 02:11:05 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:05 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215" returned: 0 in 0.465s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:05 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:11:05 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa8a03f-3e97-4bdb-b8e3-6cb6a88a1a10]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:05 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 Feb 27 02:11:05 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:05 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00" returned: 0 in 0.493s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:05 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215 Feb 27 02:11:05 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:06 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215" returned: 0 in 0.541s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:06 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215 Feb 27 02:11:06 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:06 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00.830e5e33-618b-4a14-be2e-c1c17526f215" returned: 0 in 0.424s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:06 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-830e5e33-618b-4a14-be2e-c1c17526f215" released by "_delete_snapshot" :: held 1.984s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:06 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00" released by "delete_snapshot" :: held 1.997s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:07 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] Created reservations ['4df341b0-0744-4595-8e4a-b9c75a55a312', '53fd545f-9058-4e71-89ba-fe655d7c72ae', '061c4407-acf0-465d-90b7-eeb18f33c10f', '8ac1f0e7-195c-410b-9f9e-da5dde9b7af2'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:07 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] Delete snapshot completed successfully. Feb 27 02:11:07 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-28ae8fb3-76ee-4def-9216-ffa3ce3aca43 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-830e5e33-618b-4a14-be2e-c1c17526f215-delete_snapshot" released by "delete_snapshot" :: held 2.107s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "cinder-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "cinder-quobyte-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:08 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00" acquired by "delete_volume" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:08 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef713ac-11ad-408a-8262-d6f09a736d00]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:08 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 Feb 27 02:11:08 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:08 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00" returned: 0 in 0.487s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:08 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00 Feb 27 02:11:08 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:09 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00" returned: 0 in 0.428s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00" released by "delete_volume" :: held 0.959s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] Created reservations ['77989e6e-e861-4230-8237-2a6ab20ae3a6', '7e906336-4f10-4c83-a0d7-4a8bf5f48eee', 'f9b10f57-53e3-45a3-9ac6-8c19d2b7276f', '45965f40-3059-4c0d-8bc8-b2a0e8ff6689'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:09 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:11:09 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Flow 'volume_create_manager' (01f8873e-5aaf-45f4-ad74-dc7ec22f8e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae6e7534-14ab-4a22-b64c-f899520ace9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae6e7534-14ab-4a22-b64c-f899520ace9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-748017017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e4ea4b-7281-453a-9d0b-01ec2daa414d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e7bf42f978844ebb5d3b4978dbeef15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:10Z,use_quota=True,user_id='0ac5fa74e2794a4ea0dafb6846d3d6af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ddf465d-0e3f-47ae-bef6-f4845e50774d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ddf465d-0e3f-47ae-bef6-f4845e50774d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c917941-da73-4ece-8811-8d227d94741a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c917941-da73-4ece-8811-8d227d94741a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90e4ea4b-7281-453a-9d0b-01ec2daa414d', 'volume_name': 'volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ffec5c6-0a3d-4782-8337-543b678579ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ffec5c6-0a3d-4782-8337-543b678579ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b637b3-5030-4ca6-ac67-379d17ea2a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:09 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Volume 90e4ea4b-7281-453a-9d0b-01ec2daa414d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d', 'volume_size': 1} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-748017017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e4ea4b-7281-453a-9d0b-01ec2daa414d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e7bf42f978844ebb5d3b4978dbeef15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:10Z,use_quota=True,user_id='0ac5fa74e2794a4ea0dafb6846d3d6af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Creating volume 90e4ea4b-7281-453a-9d0b-01ec2daa414d {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:09 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:09 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d 1073741824 Feb 27 02:11:09 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:09 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.483s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:09 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] Deleted volume successfully. Feb 27 02:11:09 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7fe65505-f2a5-4709-a9ff-2fcbbaf02d28 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-3d0638eb-6b36-48c5-a0cc-2cbd0d9ccd00-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:10 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d 1073741824" returned: 0 in 0.569s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:10 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d Feb 27 02:11:10 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:10 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d" returned: 0 in 0.450s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:10 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:10 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b637b3-5030-4ca6-ac67-379d17ea2a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:10 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af9c004-e30c-450e-8c30-8d2c813a5499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:10 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Volume volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d (90e4ea4b-7281-453a-9d0b-01ec2daa414d): created successfully Feb 27 02:11:10 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af9c004-e30c-450e-8c30-8d2c813a5499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:10 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Flow 'volume_create_manager' (01f8873e-5aaf-45f4-ad74-dc7ec22f8e8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:10 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-05ac943c-21f4-4759-94b4-b0022c4797b6 tempest-VolumeDependencyTests-463378128 None] Created volume successfully. Feb 27 02:11:11 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:11 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Flow 'volume_create_manager' (39a15c44-33bb-4417-adaa-ea149aaea473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:11 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32614ac1-8d00-4ef5-acc8-baed666f8ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32614ac1-8d00-4ef5-acc8-baed666f8ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1702902511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92225d16-aa5c-4e22-8cf2-cbb32830d238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e7bf42f978844ebb5d3b4978dbeef15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=90e4ea4b-7281-453a-9d0b-01ec2daa414d,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:12Z,use_quota=True,user_id='0ac5fa74e2794a4ea0dafb6846d3d6af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919755f1-748e-4053-b657-f263f027fe15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919755f1-748e-4053-b657-f263f027fe15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ff3174-7da9-4e6d-a182-88cd61953271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ff3174-7da9-4e6d-a182-88cd61953271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '92225d16-aa5c-4e22-8cf2-cbb32830d238', 'volume_name': 'volume-92225d16-aa5c-4e22-8cf2-cbb32830d238', 'volume_size': 1, 'source_volid': '90e4ea4b-7281-453a-9d0b-01ec2daa414d', 'source_volstatus': 'available'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c465e20f-0787-494c-8fd5-733802ca04eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c465e20f-0787-494c-8fd5-733802ca04eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8693fa5-083d-4bcc-a8a9-906882d0d2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:12 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Volume 92225d16-aa5c-4e22-8cf2-cbb32830d238: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-92225d16-aa5c-4e22-8cf2-cbb32830d238', 'volume_size': 1, 'source_volid': '90e4ea4b-7281-453a-9d0b-01ec2daa414d', 'source_volstatus': 'available'} Feb 27 02:11:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:12 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Cloning volume 90e4ea4b-7281-453a-9d0b-01ec2daa414d to volume 92225d16-aa5c-4e22-8cf2-cbb32830d238 Feb 27 02:11:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Creating offline snapshot d0cf648e-96a1-4e99-af09-9a37ebdc4832 of volume 90e4ea4b-7281-453a-9d0b-01ec2daa414d {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:11:12 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d70ad7-0e1a-45ba-9aef-da77dd6ae3f4]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:12 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d Feb 27 02:11:12 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:12 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d" returned: 0 in 0.480s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:12 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832 1G Feb 27 02:11:12 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:13 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832 1G" returned: 0 in 0.509s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:13 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832 Feb 27 02:11:13 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:13 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832" returned: 0 in 0.437s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:13 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832 is being set with open permissions: ugo+rw Feb 27 02:11:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:13 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832 Feb 27 02:11:13 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:13 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832" returned: 0 in 0.420s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:13 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.info Feb 27 02:11:13 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:14 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.info" returned: 0 in 0.429s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:14 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.info is being set with open permissions: ugo+rw Feb 27 02:11:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:14 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.info Feb 27 02:11:14 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:14 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.info" returned: 0 in 0.450s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Acquiring lock "cinder-quobyte-92225d16-aa5c-4e22-8cf2-cbb32830d238" by "_copy_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-92225d16-aa5c-4e22-8cf2-cbb32830d238" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] snapshot: d0cf648e-96a1-4e99-af09-9a37ebdc4832, volume: 92225d16-aa5c-4e22-8cf2-cbb32830d238, {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:11:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:14 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc4fb31-d883-466a-b6f5-b9f9e6295433]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:14 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832 Feb 27 02:11:14 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:15 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832" returned: 0 in 0.495s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:11:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:11:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Creating direct copy from snapshot {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:11:15 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02f35be-a865-4f63-aca9-46870c078519]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:15 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d Feb 27 02:11:15 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:15 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d" returned: 0 in 0.468s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:15 devstack cinder-volume[83231]: DEBUG cinder.utils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Path /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-92225d16-aa5c-4e22-8cf2-cbb32830d238 not found in is_blk_device check {{(pid=83231) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:11:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-92225d16-aa5c-4e22-8cf2-cbb32830d238 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:15 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-92225d16-aa5c-4e22-8cf2-cbb32830d238 Feb 27 02:11:15 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:18 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-92225d16-aa5c-4e22-8cf2-cbb32830d238" returned: 0 in 2.256s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:18 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baa086c-1070-48d1-9a97-189762f138a1]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:18 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d Feb 27 02:11:18 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:18 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d" returned: 0 in 0.602s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:18 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Image conversion details: src /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d, size 1024.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-92225d16-aa5c-4e22-8cf2-cbb32830d238 {{(pid=83231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:11:18 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Converted 1024.00 MB image at 453.72 MB/s Feb 27 02:11:18 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-92225d16-aa5c-4e22-8cf2-cbb32830d238 is being set with open permissions: ugo+rw Feb 27 02:11:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-92225d16-aa5c-4e22-8cf2-cbb32830d238 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:18 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-92225d16-aa5c-4e22-8cf2-cbb32830d238 Feb 27 02:11:18 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:19 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-92225d16-aa5c-4e22-8cf2-cbb32830d238" returned: 0 in 0.395s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:19 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-92225d16-aa5c-4e22-8cf2-cbb32830d238" released by "_copy_volume_from_snapshot" :: held 4.261s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:19 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Acquiring lock "cinder-quobyte-d0cf648e-96a1-4e99-af09-9a37ebdc4832" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:19 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-d0cf648e-96a1-4e99-af09-9a37ebdc4832" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Deleting offline snapshot d0cf648e-96a1-4e99-af09-9a37ebdc4832 of volume 90e4ea4b-7281-453a-9d0b-01ec2daa414d {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:11:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] snapshot_file for this snap is: volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:11:19 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d67fdf-1803-4de2-9243-a1437df2615b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:19 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832 Feb 27 02:11:19 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:19 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832" returned: 0 in 0.493s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:11:19 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2760b2-f8db-425a-9405-d2e79abe6895]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:19 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d Feb 27 02:11:19 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:20 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d" returned: 0 in 0.467s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:20 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832 Feb 27 02:11:20 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:20 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832" returned: 0 in 0.454s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:20 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832 Feb 27 02:11:20 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:20 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d.d0cf648e-96a1-4e99-af09-9a37ebdc4832" returned: 0 in 0.399s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:20 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-d0cf648e-96a1-4e99-af09-9a37ebdc4832" released by "_delete_snapshot" :: held 1.858s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.966s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:21 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8693fa5-083d-4bcc-a8a9-906882d0d2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92225d16-aa5c-4e22-8cf2-cbb32830d238', 'volume_size': 1, 'source_volid': '90e4ea4b-7281-453a-9d0b-01ec2daa414d', 'source_volstatus': 'available'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:21 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6df5728-30ea-488e-a3c2-d23277f45d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:21 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Volume volume-92225d16-aa5c-4e22-8cf2-cbb32830d238 (92225d16-aa5c-4e22-8cf2-cbb32830d238): created successfully Feb 27 02:11:21 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6df5728-30ea-488e-a3c2-d23277f45d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:21 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Flow 'volume_create_manager' (39a15c44-33bb-4417-adaa-ea149aaea473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:21 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-7bee303a-2bcc-460f-b673-c243fdc39f2b tempest-VolumeDependencyTests-463378128 None] Created volume successfully. Feb 27 02:11:21 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "cinder-90e4ea4b-7281-453a-9d0b-01ec2daa414d-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:21 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-90e4ea4b-7281-453a-9d0b-01ec2daa414d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:21 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "cinder-quobyte-90e4ea4b-7281-453a-9d0b-01ec2daa414d" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:21 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-90e4ea4b-7281-453a-9d0b-01ec2daa414d" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:21 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[589c41a1-2c41-48f5-a44c-81773866a35c]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:21 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d Feb 27 02:11:21 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:22 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d" returned: 0 in 0.469s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:22 devstack sudo[90580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d Feb 27 02:11:22 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:22 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-90e4ea4b-7281-453a-9d0b-01ec2daa414d" returned: 0 in 0.411s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-90e4ea4b-7281-453a-9d0b-01ec2daa414d" released by "delete_volume" :: held 0.914s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:22 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] Created reservations ['6c3ca450-7159-4fb5-aee7-45490e3b1d80', '3dd5bffa-d511-46f5-9387-828b0176cdf6', 'ab5e627e-8898-48c1-91a4-f27a5fbd48be', 'aa38ce79-3303-46b9-8459-2831f51fbec1'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:22 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:22 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:22 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:11:22 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] Acquiring lock "cinder-92225d16-aa5c-4e22-8cf2-cbb32830d238-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] Lock "cinder-92225d16-aa5c-4e22-8cf2-cbb32830d238-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] Acquiring lock "cinder-quobyte-92225d16-aa5c-4e22-8cf2-cbb32830d238" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-92225d16-aa5c-4e22-8cf2-cbb32830d238" acquired by "delete_volume" :: waited 0.019s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:22 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91fa435-c91d-4b9b-90ed-5133ad59d157]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-92225d16-aa5c-4e22-8cf2-cbb32830d238 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:22 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-92225d16-aa5c-4e22-8cf2-cbb32830d238 Feb 27 02:11:22 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:23 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.438s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:23 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] Deleted volume successfully. Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-a43e5cd7-794b-423a-8590-13ee879115a5 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-90e4ea4b-7281-453a-9d0b-01ec2daa414d-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:23 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-92225d16-aa5c-4e22-8cf2-cbb32830d238" returned: 0 in 0.480s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-92225d16-aa5c-4e22-8cf2-cbb32830d238 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:23 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-92225d16-aa5c-4e22-8cf2-cbb32830d238 Feb 27 02:11:23 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:23 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-92225d16-aa5c-4e22-8cf2-cbb32830d238" returned: 0 in 0.385s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-92225d16-aa5c-4e22-8cf2-cbb32830d238" released by "delete_volume" :: held 0.887s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] Created reservations ['e9633453-9faf-4993-808d-c64d8d08fbc0', '80f2987c-8696-46c4-9162-5187c246823d', '0756fca2-95ac-4b1a-a9ab-c81d6619be92', '1ac98f52-7b63-4e81-b49e-6babba1d002b'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:23 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:11:23 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "cinder-b3552e35-1f06-4fa0-882c-45b287f54e71-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-b3552e35-1f06-4fa0-882c-45b287f54e71-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "cinder-quobyte-b3552e35-1f06-4fa0-882c-45b287f54e71" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-b3552e35-1f06-4fa0-882c-45b287f54e71" acquired by "delete_volume" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7075da-e701-40aa-9561-c5a0739c5c3b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b3552e35-1f06-4fa0-882c-45b287f54e71 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:24 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b3552e35-1f06-4fa0-882c-45b287f54e71 Feb 27 02:11:24 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:24 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.436s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:24 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:24 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] Deleted volume successfully. Feb 27 02:11:24 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-9eb49f4e-5ac4-46b5-9dad-35578404adaf tempest-VolumeDependencyTests-463378128 None] Lock "cinder-92225d16-aa5c-4e22-8cf2-cbb32830d238-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:24 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b3552e35-1f06-4fa0-882c-45b287f54e71" returned: 0 in 0.494s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b3552e35-1f06-4fa0-882c-45b287f54e71 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:24 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b3552e35-1f06-4fa0-882c-45b287f54e71 Feb 27 02:11:24 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:24 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-b3552e35-1f06-4fa0-882c-45b287f54e71" returned: 0 in 0.432s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:24 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-quobyte-b3552e35-1f06-4fa0-882c-45b287f54e71" released by "delete_volume" :: held 0.952s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:24 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] Created reservations ['21a05732-9848-4071-a62b-29d3d23dd988', 'e7437d2e-25b5-4f68-bc58-7e2ef202efb3', 'feaeaa89-d91c-41c1-a4f0-b68acdf56e5b', '0d52f67f-67c1-4deb-bc4a-4a2d32af5d29'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:24 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:24 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:25 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:11:25 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:25 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.504s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:25 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:25 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] Deleted volume successfully. Feb 27 02:11:25 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-d51e25c8-5004-40c1-a774-d1cd4236f556 tempest-VolumeDependencyTests-463378128 None] Lock "cinder-b3552e35-1f06-4fa0-882c-45b287f54e71-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:33 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Flow 'volume_create_manager' (1777bb58-0e68-422d-80bc-a25aad82e9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:33 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a133c78e-dad3-4abe-a399-54950263a778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a133c78e-dad3-4abe-a399-54950263a778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-481113766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20596bf3-70b1-498e-bc98-002c2fb38629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19623f2833a46289359171814e5cd06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:34Z,use_quota=True,user_id='540e415eaaa64fe582a95ccd3188fcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62afe9d-83f8-4265-8322-fa816879844c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62afe9d-83f8-4265-8322-fa816879844c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b580f208-f591-4743-9a96-9410f712f773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b580f208-f591-4743-9a96-9410f712f773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20596bf3-70b1-498e-bc98-002c2fb38629', 'volume_name': 'volume-20596bf3-70b1-498e-bc98-002c2fb38629', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e14b89d-aab3-4e95-aef6-0b19507dadb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e14b89d-aab3-4e95-aef6-0b19507dadb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fc5697-613b-41f8-8bdf-c2d1a37640ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Volume 20596bf3-70b1-498e-bc98-002c2fb38629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20596bf3-70b1-498e-bc98-002c2fb38629', 'volume_size': 1} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-481113766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20596bf3-70b1-498e-bc98-002c2fb38629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19623f2833a46289359171814e5cd06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:34Z,use_quota=True,user_id='540e415eaaa64fe582a95ccd3188fcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Creating volume 20596bf3-70b1-498e-bc98-002c2fb38629 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:34 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:34 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 1073741824 Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:34 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Flow 'volume_create_manager' (0ee6cf21-af56-4bcc-8060-ebe979ab397b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b018ca2-848b-4746-a98c-e0554fda97a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b018ca2-848b-4746-a98c-e0554fda97a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1832624422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ea9b51-c925-436f-8cb3-1951d0ac9740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2455f783d244748a681a28175de33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:34Z,use_quota=True,user_id='47caea891dbd429ca4e2334f02b13d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f007d7b-c50d-4fd6-854d-43d0e6a996ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f007d7b-c50d-4fd6-854d-43d0e6a996ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9adf8403-931a-434c-af8c-6e1e9527c056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9adf8403-931a-434c-af8c-6e1e9527c056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7ea9b51-c925-436f-8cb3-1951d0ac9740', 'volume_name': 'volume-f7ea9b51-c925-436f-8cb3-1951d0ac9740', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9bc7ba-2789-4ce8-b2d5-662d68945772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9bc7ba-2789-4ce8-b2d5-662d68945772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e2e81b-cdd0-44b6-9d44-9753be6c6e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Volume f7ea9b51-c925-436f-8cb3-1951d0ac9740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7ea9b51-c925-436f-8cb3-1951d0ac9740', 'volume_size': 1} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Flow 'volume_create_manager' (4388daad-a74e-4aac-a137-46dbc1856d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e758aea7-bab4-4a78-b23f-f31aefaaba89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e758aea7-bab4-4a78-b23f-f31aefaaba89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-700835703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d966bd22-87c8-431c-b857-5f7eb06923f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db3d31e47f441f58ee70aa7c768deb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:34Z,use_quota=True,user_id='3b6c23b8158b491491975ceeecdb62bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a201b3ea-7fae-43a9-8234-429403045173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a201b3ea-7fae-43a9-8234-429403045173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21a7857-ba80-40cd-a442-aa836e335943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21a7857-ba80-40cd-a442-aa836e335943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd966bd22-87c8-431c-b857-5f7eb06923f1', 'volume_name': 'volume-d966bd22-87c8-431c-b857-5f7eb06923f1', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f06b8d0-8046-4cef-821a-9fadf58746db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f06b8d0-8046-4cef-821a-9fadf58746db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa76988-8f3a-49db-99e0-0b89aacfdeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Volume d966bd22-87c8-431c-b857-5f7eb06923f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d966bd22-87c8-431c-b857-5f7eb06923f1', 'volume_size': 1} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Flow 'volume_create_manager' (ce3d3426-e772-412b-981c-123611592ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878f6b00-bf28-4437-be62-0fa7a93e263e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878f6b00-bf28-4437-be62-0fa7a93e263e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1401863708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c19d4f0-1eae-4dd6-8a40-b7f947b83284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2455f783d244748a681a28175de33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:34Z,use_quota=True,user_id='47caea891dbd429ca4e2334f02b13d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec69fdb4-4b59-4536-8c97-d0d4d4a3cb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec69fdb4-4b59-4536-8c97-d0d4d4a3cb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf82b2a-7025-42bf-9b1e-1e4253b63afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf82b2a-7025-42bf-9b1e-1e4253b63afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c19d4f0-1eae-4dd6-8a40-b7f947b83284', 'volume_name': 'volume-6c19d4f0-1eae-4dd6-8a40-b7f947b83284', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6e4ff3-84a8-4f8f-8ae5-0d80fc72c88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6e4ff3-84a8-4f8f-8ae5-0d80fc72c88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40296c5-a822-46ea-a416-52a684d7e6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Volume 6c19d4f0-1eae-4dd6-8a40-b7f947b83284: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c19d4f0-1eae-4dd6-8a40-b7f947b83284', 'volume_size': 1} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Flow 'volume_create_manager' (610f1adc-15de-4c7d-95c7-dc3553a286a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e67cb6e-6297-4971-bcb6-fdacedf3d3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e67cb6e-6297-4971-bcb6-fdacedf3d3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1448422143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cdc7d6c-539a-40fb-8d0a-f9113b36def3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2455f783d244748a681a28175de33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:35Z,use_quota=True,user_id='47caea891dbd429ca4e2334f02b13d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9256c5e1-e87a-4775-8c1d-78d74423a0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9256c5e1-e87a-4775-8c1d-78d74423a0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e312b08-401e-4c70-b98c-9ef9daaad880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e312b08-401e-4c70-b98c-9ef9daaad880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cdc7d6c-539a-40fb-8d0a-f9113b36def3', 'volume_name': 'volume-0cdc7d6c-539a-40fb-8d0a-f9113b36def3', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a62b09-8d8b-4561-aefc-bc5086c1e725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a62b09-8d8b-4561-aefc-bc5086c1e725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2098c8b8-48f3-4ddb-9c02-c28a1eece3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Volume 0cdc7d6c-539a-40fb-8d0a-f9113b36def3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cdc7d6c-539a-40fb-8d0a-f9113b36def3', 'volume_size': 1} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:34 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Flow 'volume_create_manager' (be35a5e4-083e-45a4-8634-ba3aed83ceb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c255f539-94aa-4792-b464-c95aedd60c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 1073741824" returned: 0 in 0.880s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:34 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c255f539-94aa-4792-b464-c95aedd60c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1464806215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ebdae9-1161-4d3d-b958-e6d7793bf4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2455f783d244748a681a28175de33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:35Z,use_quota=True,user_id='47caea891dbd429ca4e2334f02b13d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204ce019-52f1-4805-b7f4-dded5aaa521e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204ce019-52f1-4805-b7f4-dded5aaa521e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae9dd69e-e444-4348-a2d0-9e3a5150a7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae9dd69e-e444-4348-a2d0-9e3a5150a7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ebdae9-1161-4d3d-b958-e6d7793bf4e4', 'volume_name': 'volume-94ebdae9-1161-4d3d-b958-e6d7793bf4e4', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1eaef9-fbff-4495-8e6c-a5e89282be80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1eaef9-fbff-4495-8e6c-a5e89282be80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0cfc52-3392-42d7-8271-5f4dafb9fcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:35 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Volume 94ebdae9-1161-4d3d-b958-e6d7793bf4e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ebdae9-1161-4d3d-b958-e6d7793bf4e4', 'volume_size': 1} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:35 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 Feb 27 02:11:35 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Flow 'volume_create_manager' (a32e51c0-606a-45a5-a034-853ea0b36c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e180cd-53e7-4030-b65a-ee726c621e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e180cd-53e7-4030-b65a-ee726c621e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1683116294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4d3df9-ca95-4624-9d0d-b9befee0993e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2455f783d244748a681a28175de33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:35Z,use_quota=True,user_id='47caea891dbd429ca4e2334f02b13d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee0d90e-d21f-426c-8ce4-5a0059c8b740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee0d90e-d21f-426c-8ce4-5a0059c8b740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e9955d-516b-44d1-8e04-1c4ec36e716a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e9955d-516b-44d1-8e04-1c4ec36e716a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed4d3df9-ca95-4624-9d0d-b9befee0993e', 'volume_name': 'volume-ed4d3df9-ca95-4624-9d0d-b9befee0993e', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739faf22-fa8a-41a4-a60c-a933f9202d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739faf22-fa8a-41a4-a60c-a933f9202d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35383f94-1c8b-4a7d-adf4-aef593ab069e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:35 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Volume ed4d3df9-ca95-4624-9d0d-b9befee0993e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed4d3df9-ca95-4624-9d0d-b9befee0993e', 'volume_size': 1} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:35 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629" returned: 0 in 0.470s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.247s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1832624422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ea9b51-c925-436f-8cb3-1951d0ac9740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2455f783d244748a681a28175de33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:34Z,use_quota=True,user_id='47caea891dbd429ca4e2334f02b13d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Creating volume f7ea9b51-c925-436f-8cb3-1951d0ac9740 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:35 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f7ea9b51-c925-436f-8cb3-1951d0ac9740 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fc5697-613b-41f8-8bdf-c2d1a37640ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20596bf3-70b1-498e-bc98-002c2fb38629', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee12550-7efa-4db7-98ab-0558568dfdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:35 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f7ea9b51-c925-436f-8cb3-1951d0ac9740 1073741824 Feb 27 02:11:35 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Volume volume-20596bf3-70b1-498e-bc98-002c2fb38629 (20596bf3-70b1-498e-bc98-002c2fb38629): created successfully Feb 27 02:11:35 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee12550-7efa-4db7-98ab-0558568dfdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:35 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Flow 'volume_create_manager' (1777bb58-0e68-422d-80bc-a25aad82e9d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:35 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-34992984-fadd-4b5f-918e-5d1812f50275 tempest-VolumeDependencyTests-122603111 None] Created volume successfully. Feb 27 02:11:36 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f7ea9b51-c925-436f-8cb3-1951d0ac9740 1073741824" returned: 0 in 0.583s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f7ea9b51-c925-436f-8cb3-1951d0ac9740 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:36 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f7ea9b51-c925-436f-8cb3-1951d0ac9740 Feb 27 02:11:36 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1355672b-9a5c-4dad-b56a-24abda0a9100 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:36 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f7ea9b51-c925-436f-8cb3-1951d0ac9740" returned: 0 in 0.450s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.235s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-700835703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d966bd22-87c8-431c-b857-5f7eb06923f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db3d31e47f441f58ee70aa7c768deb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:34Z,use_quota=True,user_id='3b6c23b8158b491491975ceeecdb62bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Creating volume d966bd22-87c8-431c-b857-5f7eb06923f1 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:36 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d966bd22-87c8-431c-b857-5f7eb06923f1 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e2e81b-cdd0-44b6-9d44-9753be6c6e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7ea9b51-c925-436f-8cb3-1951d0ac9740', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:36 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d966bd22-87c8-431c-b857-5f7eb06923f1 1073741824 Feb 27 02:11:36 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d14163e-f549-4974-ac8e-c0f56258aee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:36 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Volume volume-f7ea9b51-c925-436f-8cb3-1951d0ac9740 (f7ea9b51-c925-436f-8cb3-1951d0ac9740): created successfully Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d14163e-f549-4974-ac8e-c0f56258aee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:36 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Flow 'volume_create_manager' (0ee6cf21-af56-4bcc-8060-ebe979ab397b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:36 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-cc3c725d-7e4f-43bd-897b-7d10bc26ab0d tempest-CreateVolumesFromImageTest-1308120389 None] Created volume successfully. Feb 27 02:11:37 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d966bd22-87c8-431c-b857-5f7eb06923f1 1073741824" returned: 0 in 0.555s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d966bd22-87c8-431c-b857-5f7eb06923f1 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:37 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d966bd22-87c8-431c-b857-5f7eb06923f1 Feb 27 02:11:37 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:37 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d966bd22-87c8-431c-b857-5f7eb06923f1" returned: 0 in 0.544s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.286s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1401863708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c19d4f0-1eae-4dd6-8a40-b7f947b83284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2455f783d244748a681a28175de33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:34Z,use_quota=True,user_id='47caea891dbd429ca4e2334f02b13d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Creating volume 6c19d4f0-1eae-4dd6-8a40-b7f947b83284 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:37 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:11:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6c19d4f0-1eae-4dd6-8a40-b7f947b83284 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa76988-8f3a-49db-99e0-0b89aacfdeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d966bd22-87c8-431c-b857-5f7eb06923f1', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c7c99e-f3f2-443d-94f7-22d77d3ffe8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:37 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6c19d4f0-1eae-4dd6-8a40-b7f947b83284 1073741824 Feb 27 02:11:37 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:37 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Volume volume-d966bd22-87c8-431c-b857-5f7eb06923f1 (d966bd22-87c8-431c-b857-5f7eb06923f1): created successfully Feb 27 02:11:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c7c99e-f3f2-443d-94f7-22d77d3ffe8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:37 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Flow 'volume_create_manager' (4388daad-a74e-4aac-a137-46dbc1856d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:37 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-32a6686f-6969-4eef-ac80-59bcd89c954d tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Created volume successfully. Feb 27 02:11:38 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6c19d4f0-1eae-4dd6-8a40-b7f947b83284 1073741824" returned: 0 in 0.639s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6c19d4f0-1eae-4dd6-8a40-b7f947b83284 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:38 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6c19d4f0-1eae-4dd6-8a40-b7f947b83284 Feb 27 02:11:38 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Flow 'volume_create_manager' (c5da2b7a-bf87-4dbb-aa7f-7ef1b815e2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b643afb5-a64f-435f-833d-f10a99109c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b643afb5-a64f-435f-833d-f10a99109c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-174942927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920814b0-14b6-49a4-b7d3-f62be723c0cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db3d31e47f441f58ee70aa7c768deb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:39Z,use_quota=True,user_id='3b6c23b8158b491491975ceeecdb62bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6be7042-90cc-4f31-a51a-1c4e1178fe24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6be7042-90cc-4f31-a51a-1c4e1178fe24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1155a5bb-3a20-4f24-9a06-3d3012130889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1155a5bb-3a20-4f24-9a06-3d3012130889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '920814b0-14b6-49a4-b7d3-f62be723c0cc', 'volume_name': 'volume-920814b0-14b6-49a4-b7d3-f62be723c0cc', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e37c05-dd70-40f4-82b1-cbc52c53e20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e37c05-dd70-40f4-82b1-cbc52c53e20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2425882c-2dac-4089-a666-20eaa5849369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Volume 920814b0-14b6-49a4-b7d3-f62be723c0cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-920814b0-14b6-49a4-b7d3-f62be723c0cc', 'volume_size': 1} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:38 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6c19d4f0-1eae-4dd6-8a40-b7f947b83284" returned: 0 in 0.457s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.127s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1448422143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cdc7d6c-539a-40fb-8d0a-f9113b36def3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2455f783d244748a681a28175de33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:35Z,use_quota=True,user_id='47caea891dbd429ca4e2334f02b13d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Creating volume 0cdc7d6c-539a-40fb-8d0a-f9113b36def3 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:38 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0cdc7d6c-539a-40fb-8d0a-f9113b36def3 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40296c5-a822-46ea-a416-52a684d7e6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c19d4f0-1eae-4dd6-8a40-b7f947b83284', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0cdc7d6c-539a-40fb-8d0a-f9113b36def3 1073741824 Feb 27 02:11:38 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22fdcc6e-1f23-49c3-b090-94f5bdd59d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Volume volume-6c19d4f0-1eae-4dd6-8a40-b7f947b83284 (6c19d4f0-1eae-4dd6-8a40-b7f947b83284): created successfully Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22fdcc6e-1f23-49c3-b090-94f5bdd59d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Flow 'volume_create_manager' (ce3d3426-e772-412b-981c-123611592ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:39 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-380f5aad-5fc1-4bcb-ba1c-3a19999edf49 tempest-CreateVolumesFromImageTest-1308120389 None] Created volume successfully. Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Flow 'volume_create_manager' (15255aca-4a24-48b2-8aa9-a887ce28f5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d774a93-11c2-41ab-ae1d-c4624c3a5f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d774a93-11c2-41ab-ae1d-c4624c3a5f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1272650918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db3d31e47f441f58ee70aa7c768deb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:39Z,use_quota=True,user_id='3b6c23b8158b491491975ceeecdb62bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603b2ab2-d131-4c62-b98b-c45a8938889a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603b2ab2-d131-4c62-b98b-c45a8938889a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5272696e-e097-4e97-8665-d15ff3a1031e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5272696e-e097-4e97-8665-d15ff3a1031e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261', 'volume_name': 'volume-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500c47ae-9270-47d2-9a33-3994f9ab62bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500c47ae-9270-47d2-9a33-3994f9ab62bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97fdfd62-0c44-4f1e-b29f-821f3906b403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Volume 0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261', 'volume_size': 1} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Flow 'volume_create_manager' (429a8382-f263-4dbd-9c8f-7a5e8a18484b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f0f8d8-2b0d-4601-ba3f-fec9cc29bd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f0f8d8-2b0d-4601-ba3f-fec9cc29bd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-770816188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd0bd01-e4bd-4ac2-a688-1eaa706e082f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db3d31e47f441f58ee70aa7c768deb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:39Z,use_quota=True,user_id='3b6c23b8158b491491975ceeecdb62bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8436a9d-f94f-4e42-bfcf-1d04a74ca4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8436a9d-f94f-4e42-bfcf-1d04a74ca4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f1f6ce-6049-47a5-9c46-17f64bacf7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f1f6ce-6049-47a5-9c46-17f64bacf7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fd0bd01-e4bd-4ac2-a688-1eaa706e082f', 'volume_name': 'volume-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c474857-4fce-4610-a332-d81aeb41da57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c474857-4fce-4610-a332-d81aeb41da57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b518389-a988-4559-85b2-04d5ce2ada72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Volume 7fd0bd01-e4bd-4ac2-a688-1eaa706e082f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f', 'volume_size': 1} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Flow 'volume_create_manager' (a091960c-17bc-4c70-83da-c1cfe37d40e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b51784-a2b6-4b99-9890-2ba3338fe1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b51784-a2b6-4b99-9890-2ba3338fe1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1338226213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5445101c-812b-4914-af0b-775afe4a8bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db3d31e47f441f58ee70aa7c768deb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:40Z,use_quota=True,user_id='3b6c23b8158b491491975ceeecdb62bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24263c3e-b204-4c1a-bbc6-245e913178ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24263c3e-b204-4c1a-bbc6-245e913178ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffeac256-ca93-4000-bfa1-bfdd008f6927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffeac256-ca93-4000-bfa1-bfdd008f6927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5445101c-812b-4914-af0b-775afe4a8bce', 'volume_name': 'volume-5445101c-812b-4914-af0b-775afe4a8bce', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc91cba-7f5e-4f24-b064-fadad42a2f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc91cba-7f5e-4f24-b064-fadad42a2f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (028ef916-1307-4e17-923a-b5faf85b26a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Volume 5445101c-812b-4914-af0b-775afe4a8bce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5445101c-812b-4914-af0b-775afe4a8bce', 'volume_size': 1} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0cdc7d6c-539a-40fb-8d0a-f9113b36def3 1073741824" returned: 0 in 0.868s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0cdc7d6c-539a-40fb-8d0a-f9113b36def3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:39 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0cdc7d6c-539a-40fb-8d0a-f9113b36def3 Feb 27 02:11:39 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Flow 'volume_create_manager' (0ef09a9a-6824-42a4-b6cf-26fa646064de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7194c634-42eb-40ca-9d7e-7d827cfff17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7194c634-42eb-40ca-9d7e-7d827cfff17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1765880202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c271ece-ed0a-402c-93f2-5da940fd96e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db3d31e47f441f58ee70aa7c768deb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:40Z,use_quota=True,user_id='3b6c23b8158b491491975ceeecdb62bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168d231d-ba09-498d-a189-02dd7f2a9b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168d231d-ba09-498d-a189-02dd7f2a9b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353ae7cc-c3cc-46ed-b9bc-14a24124ca3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353ae7cc-c3cc-46ed-b9bc-14a24124ca3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c271ece-ed0a-402c-93f2-5da940fd96e3', 'volume_name': 'volume-9c271ece-ed0a-402c-93f2-5da940fd96e3', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f13f10-74e5-4ae2-9d8b-05c03686ee50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f13f10-74e5-4ae2-9d8b-05c03686ee50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911a932e-3536-46b5-bf87-25f33e5272bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Volume 9c271ece-ed0a-402c-93f2-5da940fd96e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c271ece-ed0a-402c-93f2-5da940fd96e3', 'volume_size': 1} Feb 27 02:11:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:40 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0cdc7d6c-539a-40fb-8d0a-f9113b36def3" returned: 0 in 0.524s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:40 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.297s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:40 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1464806215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ebdae9-1161-4d3d-b958-e6d7793bf4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2455f783d244748a681a28175de33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:35Z,use_quota=True,user_id='47caea891dbd429ca4e2334f02b13d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:40 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Creating volume 94ebdae9-1161-4d3d-b958-e6d7793bf4e4 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:40 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:40 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:40 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:40 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:11:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-94ebdae9-1161-4d3d-b958-e6d7793bf4e4 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2098c8b8-48f3-4ddb-9c02-c28a1eece3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cdc7d6c-539a-40fb-8d0a-f9113b36def3', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac97d0bb-8e00-49f4-997d-e81a36c00303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:40 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-94ebdae9-1161-4d3d-b958-e6d7793bf4e4 1073741824 Feb 27 02:11:40 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:40 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Volume volume-0cdc7d6c-539a-40fb-8d0a-f9113b36def3 (0cdc7d6c-539a-40fb-8d0a-f9113b36def3): created successfully Feb 27 02:11:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac97d0bb-8e00-49f4-997d-e81a36c00303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:40 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Flow 'volume_create_manager' (610f1adc-15de-4c7d-95c7-dc3553a286a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:40 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-041a8024-6e90-48a5-9ac3-98246fb24bb3 tempest-CreateVolumesFromImageTest-1308120389 None] Created volume successfully. Feb 27 02:11:40 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:40 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-94ebdae9-1161-4d3d-b958-e6d7793bf4e4 1073741824" returned: 0 in 0.637s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-94ebdae9-1161-4d3d-b958-e6d7793bf4e4 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:41 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-94ebdae9-1161-4d3d-b958-e6d7793bf4e4 Feb 27 02:11:41 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:41 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-94ebdae9-1161-4d3d-b958-e6d7793bf4e4" returned: 0 in 0.533s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.339s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1683116294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4d3df9-ca95-4624-9d0d-b9befee0993e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2455f783d244748a681a28175de33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:35Z,use_quota=True,user_id='47caea891dbd429ca4e2334f02b13d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Creating volume ed4d3df9-ca95-4624-9d0d-b9befee0993e {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:41 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:41 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:11:41 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ed4d3df9-ca95-4624-9d0d-b9befee0993e 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0cfc52-3392-42d7-8271-5f4dafb9fcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ebdae9-1161-4d3d-b958-e6d7793bf4e4', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38338023-d561-4891-b7ad-7e57d81c48f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:41 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ed4d3df9-ca95-4624-9d0d-b9befee0993e 1073741824 Feb 27 02:11:41 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:41 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Volume volume-94ebdae9-1161-4d3d-b958-e6d7793bf4e4 (94ebdae9-1161-4d3d-b958-e6d7793bf4e4): created successfully Feb 27 02:11:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38338023-d561-4891-b7ad-7e57d81c48f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:41 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Flow 'volume_create_manager' (be35a5e4-083e-45a4-8634-ba3aed83ceb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:41 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-e7c6b891-4907-4533-9b60-4364fb424ca2 tempest-CreateVolumesFromImageTest-1308120389 None] Created volume successfully. Feb 27 02:11:42 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ed4d3df9-ca95-4624-9d0d-b9befee0993e 1073741824" returned: 0 in 0.638s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ed4d3df9-ca95-4624-9d0d-b9befee0993e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:42 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ed4d3df9-ca95-4624-9d0d-b9befee0993e Feb 27 02:11:42 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:42 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ed4d3df9-ca95-4624-9d0d-b9befee0993e" returned: 0 in 0.604s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1355672b-9a5c-4dad-b56a-24abda0a9100 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.376s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35383f94-1c8b-4a7d-adf4-aef593ab069e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed4d3df9-ca95-4624-9d0d-b9befee0993e', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b0cf26-ace7-47fe-bdf8-0bb419c4723c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:42 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-1355672b-9a5c-4dad-b56a-24abda0a9100 tempest-VolumeDependencyTests-122603111 None] Creating offline snapshot fdf86be5-9562-4be8-9f4c-3b1e865c9e2b of volume 20596bf3-70b1-498e-bc98-002c2fb38629 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:11:42 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c02a39-3cb9-40ea-9f52-46886687cb26]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:42 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1355672b-9a5c-4dad-b56a-24abda0a9100 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:42 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Volume volume-ed4d3df9-ca95-4624-9d0d-b9befee0993e (ed4d3df9-ca95-4624-9d0d-b9befee0993e): created successfully Feb 27 02:11:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b0cf26-ace7-47fe-bdf8-0bb419c4723c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:42 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Flow 'volume_create_manager' (a32e51c0-606a-45a5-a034-853ea0b36c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:42 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-77c804ce-e143-489a-8dd1-7eb7abebd42d tempest-CreateVolumesFromImageTest-1308120389 None] Created volume successfully. Feb 27 02:11:42 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 Feb 27 02:11:42 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:43 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1355672b-9a5c-4dad-b56a-24abda0a9100 tempest-VolumeDependencyTests-122603111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629" returned: 0 in 0.632s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:43 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1355672b-9a5c-4dad-b56a-24abda0a9100 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:43 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b 1G Feb 27 02:11:43 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:43 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "cinder-ed4d3df9-ca95-4624-9d0d-b9befee0993e-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:43 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-ed4d3df9-ca95-4624-9d0d-b9befee0993e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:43 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=88,cinder:INSERT=25,cinder:UPDATE=111,cinder:DELETE=12 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:11:44 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=72,cinder:UPDATE=101,cinder:INSERT=22,cinder:DELETE=9 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:11:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "cinder-quobyte-ed4d3df9-ca95-4624-9d0d-b9befee0993e" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:44 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-quobyte-ed4d3df9-ca95-4624-9d0d-b9befee0993e" acquired by "delete_volume" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:44 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d88f3fa-3e1e-4690-af77-e354e12eb53d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ed4d3df9-ca95-4624-9d0d-b9befee0993e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:44 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ed4d3df9-ca95-4624-9d0d-b9befee0993e Feb 27 02:11:44 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:44 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1355672b-9a5c-4dad-b56a-24abda0a9100 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b 1G" returned: 0 in 0.775s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1355672b-9a5c-4dad-b56a-24abda0a9100 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20596bf3-70b1-498e-bc98-002c2fb38629 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:44 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20596bf3-70b1-498e-bc98-002c2fb38629 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b Feb 27 02:11:44 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:44 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ed4d3df9-ca95-4624-9d0d-b9befee0993e" returned: 0 in 0.765s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ed4d3df9-ca95-4624-9d0d-b9befee0993e {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:44 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ed4d3df9-ca95-4624-9d0d-b9befee0993e Feb 27 02:11:44 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:44 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1355672b-9a5c-4dad-b56a-24abda0a9100 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20596bf3-70b1-498e-bc98-002c2fb38629 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b" returned: 0 in 0.629s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:44 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-1355672b-9a5c-4dad-b56a-24abda0a9100 tempest-VolumeDependencyTests-122603111 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b is being set with open permissions: ugo+rw Feb 27 02:11:44 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1355672b-9a5c-4dad-b56a-24abda0a9100 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:44 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b Feb 27 02:11:44 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:45 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-ed4d3df9-ca95-4624-9d0d-b9befee0993e" returned: 0 in 0.673s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:45 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-quobyte-ed4d3df9-ca95-4624-9d0d-b9befee0993e" released by "delete_volume" :: held 1.473s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:45 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1355672b-9a5c-4dad-b56a-24abda0a9100 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b" returned: 0 in 0.623s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:45 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] Created reservations ['0558497d-6307-48d7-a347-70ed500d1b34', 'fc9654be-685c-42a9-aa8e-b4483d805e40', '106c9ff3-b6a0-4142-b036-41b587048eb2', '84b9713f-00b4-43a2-bec9-f8e141b882f1'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1355672b-9a5c-4dad-b56a-24abda0a9100 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:45 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.info Feb 27 02:11:45 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:45 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:45 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:45 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:11:45 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:46 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1355672b-9a5c-4dad-b56a-24abda0a9100 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.info" returned: 0 in 0.484s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:46 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-1355672b-9a5c-4dad-b56a-24abda0a9100 tempest-VolumeDependencyTests-122603111 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.info is being set with open permissions: ugo+rw Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1355672b-9a5c-4dad-b56a-24abda0a9100 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:46 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.info Feb 27 02:11:46 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:46 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.487s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:46 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] Deleted volume successfully. Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b7e8e435-6812-49a1-8fac-7ba793ca3ff1 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-ed4d3df9-ca95-4624-9d0d-b9befee0993e-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "cinder-94ebdae9-1161-4d3d-b958-e6d7793bf4e4-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-94ebdae9-1161-4d3d-b958-e6d7793bf4e4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "cinder-quobyte-94ebdae9-1161-4d3d-b958-e6d7793bf4e4" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-quobyte-94ebdae9-1161-4d3d-b958-e6d7793bf4e4" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[81040447-e679-4675-b28a-500eb2c31776]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-94ebdae9-1161-4d3d-b958-e6d7793bf4e4 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:46 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-94ebdae9-1161-4d3d-b958-e6d7793bf4e4 Feb 27 02:11:46 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:46 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1355672b-9a5c-4dad-b56a-24abda0a9100 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.info" returned: 0 in 0.520s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1355672b-9a5c-4dad-b56a-24abda0a9100 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.767s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.724s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-174942927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920814b0-14b6-49a4-b7d3-f62be723c0cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db3d31e47f441f58ee70aa7c768deb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:39Z,use_quota=True,user_id='3b6c23b8158b491491975ceeecdb62bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Creating volume 920814b0-14b6-49a4-b7d3-f62be723c0cc {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:46 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-920814b0-14b6-49a4-b7d3-f62be723c0cc 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:46 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-920814b0-14b6-49a4-b7d3-f62be723c0cc 1073741824 Feb 27 02:11:46 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-1355672b-9a5c-4dad-b56a-24abda0a9100 tempest-VolumeDependencyTests-122603111 None] Create snapshot completed successfully Feb 27 02:11:46 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:46 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-94ebdae9-1161-4d3d-b958-e6d7793bf4e4" returned: 0 in 0.615s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:46 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-94ebdae9-1161-4d3d-b958-e6d7793bf4e4 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:46 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-94ebdae9-1161-4d3d-b958-e6d7793bf4e4 Feb 27 02:11:46 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG oslo_service.periodic_task [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83231) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:47 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:11:47 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:47 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-920814b0-14b6-49a4-b7d3-f62be723c0cc 1073741824" returned: 0 in 0.813s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Flow 'volume_create_manager' (0934baca-8081-477a-922c-2501ba98bec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52222df-2952-4412-bc1a-41b71bad775e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52222df-2952-4412-bc1a-41b71bad775e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-429364578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5050af03-63bf-4485-8292-fa23b76a3fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19623f2833a46289359171814e5cd06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fdf86be5-9562-4be8-9f4c-3b1e865c9e2b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:47Z,use_quota=True,user_id='540e415eaaa64fe582a95ccd3188fcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:47 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e7375b-bfbd-4c50-9735-63a66cb2e6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e7375b-bfbd-4c50-9735-63a66cb2e6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4930f199-eef5-4495-8a94-7d4b4115f7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4930f199-eef5-4495-8a94-7d4b4115f7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5050af03-63bf-4485-8292-fa23b76a3fb9', 'volume_name': 'volume-5050af03-63bf-4485-8292-fa23b76a3fb9', 'volume_size': 1, 'snapshot_id': 'fdf86be5-9562-4be8-9f4c-3b1e865c9e2b'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0882292-6600-4fb0-870a-bd1aee13661e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0882292-6600-4fb0-870a-bd1aee13661e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f2d939-0006-4af6-822e-37ea89a96aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:47 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Volume 5050af03-63bf-4485-8292-fa23b76a3fb9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5050af03-63bf-4485-8292-fa23b76a3fb9', 'volume_size': 1, 'snapshot_id': 'fdf86be5-9562-4be8-9f4c-3b1e865c9e2b'} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-920814b0-14b6-49a4-b7d3-f62be723c0cc {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-94ebdae9-1161-4d3d-b958-e6d7793bf4e4" returned: 0 in 0.645s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-quobyte-94ebdae9-1161-4d3d-b958-e6d7793bf4e4" released by "delete_volume" :: held 1.295s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:47 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-920814b0-14b6-49a4-b7d3-f62be723c0cc Feb 27 02:11:47 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] Created reservations ['5ea223c3-1cbc-4177-9841-49ec497295d8', '513d7f89-2ef4-4fc0-81ee-1490cd433ed6', 'caca360c-70db-49de-bf0b-d7d91cc435fb', 'af6265f6-c834-462a-a285-072aa363fbef'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:47 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:11:47 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:47 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.633s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:47 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:48 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-920814b0-14b6-49a4-b7d3-f62be723c0cc" returned: 0 in 0.544s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.903s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1272650918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db3d31e47f441f58ee70aa7c768deb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:39Z,use_quota=True,user_id='3b6c23b8158b491491975ceeecdb62bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Creating volume 0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:48 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2425882c-2dac-4089-a666-20eaa5849369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-920814b0-14b6-49a4-b7d3-f62be723c0cc', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f742e9d-0b27-49c7-bd83-ee2934a3a577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:48 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261 1073741824 Feb 27 02:11:48 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:48 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Volume volume-920814b0-14b6-49a4-b7d3-f62be723c0cc (920814b0-14b6-49a4-b7d3-f62be723c0cc): created successfully Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f742e9d-0b27-49c7-bd83-ee2934a3a577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Flow 'volume_create_manager' (c5da2b7a-bf87-4dbb-aa7f-7ef1b815e2af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:48 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b87a4fd4-01cb-4d3f-8350-c71582485b1e tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Created volume successfully. Feb 27 02:11:48 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.521s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:48 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] Deleted volume successfully. Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ddfd17f8-c235-48a7-8013-3883da7e2705 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-94ebdae9-1161-4d3d-b958-e6d7793bf4e4-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "cinder-0cdc7d6c-539a-40fb-8d0a-f9113b36def3-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-0cdc7d6c-539a-40fb-8d0a-f9113b36def3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "cinder-quobyte-0cdc7d6c-539a-40fb-8d0a-f9113b36def3" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-quobyte-0cdc7d6c-539a-40fb-8d0a-f9113b36def3" acquired by "delete_volume" :: waited 0.012s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[959c2899-a069-4dac-947f-d013bd9d579e]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0cdc7d6c-539a-40fb-8d0a-f9113b36def3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:48 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0cdc7d6c-539a-40fb-8d0a-f9113b36def3 Feb 27 02:11:48 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:48 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261 1073741824" returned: 0 in 0.619s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:48 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:48 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261 Feb 27 02:11:48 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:49 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0cdc7d6c-539a-40fb-8d0a-f9113b36def3" returned: 0 in 0.590s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0cdc7d6c-539a-40fb-8d0a-f9113b36def3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:49 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0cdc7d6c-539a-40fb-8d0a-f9113b36def3 Feb 27 02:11:49 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:49 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261" returned: 0 in 0.496s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.776s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-770816188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd0bd01-e4bd-4ac2-a688-1eaa706e082f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db3d31e47f441f58ee70aa7c768deb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:39Z,use_quota=True,user_id='3b6c23b8158b491491975ceeecdb62bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Creating volume 7fd0bd01-e4bd-4ac2-a688-1eaa706e082f {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:49 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:49 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f 1073741824 Feb 27 02:11:49 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97fdfd62-0c44-4f1e-b29f-821f3906b403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd4f31b-97ff-4725-9d56-0e3e7920e7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:49 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Volume volume-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261 (0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261): created successfully Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd4f31b-97ff-4725-9d56-0e3e7920e7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Flow 'volume_create_manager' (15255aca-4a24-48b2-8aa9-a887ce28f5db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:49 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-780fcb9a-916f-4eb0-a777-0329e52658f6 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Created volume successfully. Feb 27 02:11:49 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0cdc7d6c-539a-40fb-8d0a-f9113b36def3" returned: 0 in 0.567s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-quobyte-0cdc7d6c-539a-40fb-8d0a-f9113b36def3" released by "delete_volume" :: held 1.185s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] Created reservations ['bef17507-36bd-4d28-9aba-d0a572e16b19', '59afcedf-de0a-4ede-ba15-086d90751a0b', '01e4dd28-69cf-41c6-97e5-1ed92aea68e8', 'ff1c6978-4279-44f8-a06f-14db80239427'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:49 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:49 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:11:49 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:50 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f 1073741824" returned: 0 in 0.782s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:50 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f Feb 27 02:11:50 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:50 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.515s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:50 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] Deleted volume successfully. Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-91529445-4349-4a45-96e8-5cf3dcd778be tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-0cdc7d6c-539a-40fb-8d0a-f9113b36def3-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:50 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f" returned: 0 in 0.518s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.854s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1338226213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5445101c-812b-4914-af0b-775afe4a8bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db3d31e47f441f58ee70aa7c768deb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:40Z,use_quota=True,user_id='3b6c23b8158b491491975ceeecdb62bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Creating volume 5445101c-812b-4914-af0b-775afe4a8bce {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:50 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5445101c-812b-4914-af0b-775afe4a8bce 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b518389-a988-4559-85b2-04d5ce2ada72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:50 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5445101c-812b-4914-af0b-775afe4a8bce 1073741824 Feb 27 02:11:50 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf969c8-78ee-463f-8bc3-fc9949b9e94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "cinder-6c19d4f0-1eae-4dd6-8a40-b7f947b83284-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:50 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Volume volume-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f (7fd0bd01-e4bd-4ac2-a688-1eaa706e082f): created successfully Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf969c8-78ee-463f-8bc3-fc9949b9e94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Flow 'volume_create_manager' (429a8382-f263-4dbd-9c8f-7a5e8a18484b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-6c19d4f0-1eae-4dd6-8a40-b7f947b83284-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:50 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-df12c88e-66b2-47c1-b8c1-181d27db2bf9 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Created volume successfully. Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "cinder-quobyte-6c19d4f0-1eae-4dd6-8a40-b7f947b83284" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-quobyte-6c19d4f0-1eae-4dd6-8a40-b7f947b83284" acquired by "delete_volume" :: waited 0.012s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[69182fec-03d5-4989-9426-bb02e08d2c9e]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:50 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6c19d4f0-1eae-4dd6-8a40-b7f947b83284 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:50 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6c19d4f0-1eae-4dd6-8a40-b7f947b83284 Feb 27 02:11:50 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:51 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5445101c-812b-4914-af0b-775afe4a8bce 1073741824" returned: 0 in 0.659s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5445101c-812b-4914-af0b-775afe4a8bce {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:51 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5445101c-812b-4914-af0b-775afe4a8bce Feb 27 02:11:51 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:51 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6c19d4f0-1eae-4dd6-8a40-b7f947b83284" returned: 0 in 0.620s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:51 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6c19d4f0-1eae-4dd6-8a40-b7f947b83284 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:51 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6c19d4f0-1eae-4dd6-8a40-b7f947b83284 Feb 27 02:11:51 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:52 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5445101c-812b-4914-af0b-775afe4a8bce" returned: 0 in 0.652s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.068s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1765880202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c271ece-ed0a-402c-93f2-5da940fd96e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db3d31e47f441f58ee70aa7c768deb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:40Z,use_quota=True,user_id='3b6c23b8158b491491975ceeecdb62bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Creating volume 9c271ece-ed0a-402c-93f2-5da940fd96e3 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:52 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c271ece-ed0a-402c-93f2-5da940fd96e3 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (028ef916-1307-4e17-923a-b5faf85b26a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5445101c-812b-4914-af0b-775afe4a8bce', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5df729-4147-4dd6-ad1a-48ce9cef8461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:52 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-6c19d4f0-1eae-4dd6-8a40-b7f947b83284" returned: 0 in 0.624s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:52 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c271ece-ed0a-402c-93f2-5da940fd96e3 1073741824 Feb 27 02:11:52 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:52 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Volume volume-5445101c-812b-4914-af0b-775afe4a8bce (5445101c-812b-4914-af0b-775afe4a8bce): created successfully Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5df729-4147-4dd6-ad1a-48ce9cef8461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Flow 'volume_create_manager' (a091960c-17bc-4c70-83da-c1cfe37d40e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-quobyte-6c19d4f0-1eae-4dd6-8a40-b7f947b83284" released by "delete_volume" :: held 1.293s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:52 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-fb377db6-03a8-4e2b-8c24-18bb9fee9b98 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Created volume successfully. Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] Created reservations ['d29da4b3-9cac-41a3-8e69-046e6e5be36f', '381c41a3-17e4-4511-8da0-6ba92db3b43b', 'c00e3fd2-008b-44cc-aeb6-ed3f5f3851ca', 'e54721bc-9391-4b38-ab80-043635ba3266'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:52 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:11:52 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:52 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c271ece-ed0a-402c-93f2-5da940fd96e3 1073741824" returned: 0 in 0.747s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c271ece-ed0a-402c-93f2-5da940fd96e3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:52 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c271ece-ed0a-402c-93f2-5da940fd96e3 Feb 27 02:11:52 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:52 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.612s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:52 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] Deleted volume successfully. Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b51714d0-3447-4913-b5d0-b47a780fe843 tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-6c19d4f0-1eae-4dd6-8a40-b7f947b83284-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "cinder-f7ea9b51-c925-436f-8cb3-1951d0ac9740-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:52 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-f7ea9b51-c925-436f-8cb3-1951d0ac9740-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "cinder-quobyte-f7ea9b51-c925-436f-8cb3-1951d0ac9740" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-quobyte-f7ea9b51-c925-436f-8cb3-1951d0ac9740" acquired by "delete_volume" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1629b0-1d70-467d-b427-f925f86e9662]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f7ea9b51-c925-436f-8cb3-1951d0ac9740 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:53 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f7ea9b51-c925-436f-8cb3-1951d0ac9740 Feb 27 02:11:53 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:53 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c271ece-ed0a-402c-93f2-5da940fd96e3" returned: 0 in 0.615s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.847s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Acquiring lock "cinder-quobyte-fdf86be5-9562-4be8-9f4c-3b1e865c9e2b-5050af03-63bf-4485-8292-fa23b76a3fb9" by "_create_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911a932e-3536-46b5-bf87-25f33e5272bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c271ece-ed0a-402c-93f2-5da940fd96e3', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad964449-42a3-4b2c-a638-30b35dd19f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:53 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Volume volume-9c271ece-ed0a-402c-93f2-5da940fd96e3 (9c271ece-ed0a-402c-93f2-5da940fd96e3): created successfully Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad964449-42a3-4b2c-a638-30b35dd19f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Flow 'volume_create_manager' (0ef09a9a-6824-42a4-b6cf-26fa646064de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-fdf86be5-9562-4be8-9f4c-3b1e865c9e2b-5050af03-63bf-4485-8292-fa23b76a3fb9" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Creating volume 5050af03-63bf-4485-8292-fa23b76a3fb9 from snapshot fdf86be5-9562-4be8-9f4c-3b1e865c9e2b {{(pid=83231) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Acquiring lock "cinder-quobyte-5050af03-63bf-4485-8292-fa23b76a3fb9" by "_copy_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:53 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b485dee6-a9e7-421c-94c6-71f5dff3cb70 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Created volume successfully. Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-5050af03-63bf-4485-8292-fa23b76a3fb9" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] snapshot: fdf86be5-9562-4be8-9f4c-3b1e865c9e2b, volume: 5050af03-63bf-4485-8292-fa23b76a3fb9, {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[621c176d-ed84-471a-a533-89cc4ce88ad2]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:53 devstack sudo[90824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b Feb 27 02:11:53 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:53 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Flow 'volume_create_manager' (4090dbf0-d9b3-4127-b227-479f63f6e769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b830fdd-e7dd-4456-86c7-9db6ff919b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f7ea9b51-c925-436f-8cb3-1951d0ac9740" returned: 0 in 0.724s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f7ea9b51-c925-436f-8cb3-1951d0ac9740 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:53 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f7ea9b51-c925-436f-8cb3-1951d0ac9740 Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b830fdd-e7dd-4456-86c7-9db6ff919b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-190221066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333329b1-1bdd-4e1a-9181-05585a3aad17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc6e1a1f44c4728a2eeef47d042f47b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:54Z,use_quota=True,user_id='c272771bf9984346b9593eb4b2c71436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:53 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109b9e4c-0f87-4199-ac42-55dc0a89032f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109b9e4c-0f87-4199-ac42-55dc0a89032f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d52cac27-8cb7-44db-9c57-233926526869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d52cac27-8cb7-44db-9c57-233926526869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '333329b1-1bdd-4e1a-9181-05585a3aad17', 'volume_name': 'volume-333329b1-1bdd-4e1a-9181-05585a3aad17', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90357f64-33af-4b0b-8a7d-2426a62f057b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90357f64-33af-4b0b-8a7d-2426a62f057b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f05afd5-7b67-4463-a1ac-4ff4e981385e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:53 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Volume 333329b1-1bdd-4e1a-9181-05585a3aad17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-333329b1-1bdd-4e1a-9181-05585a3aad17', 'volume_size': 1} Feb 27 02:11:53 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:54 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b" returned: 0 in 0.628s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20596bf3-70b1-498e-bc98-002c2fb38629(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Creating direct copy from snapshot {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[009fe57a-34fa-4e6b-b973-f12b0d724804]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "cinder-9c271ece-ed0a-402c-93f2-5da940fd96e3-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-9c271ece-ed0a-402c-93f2-5da940fd96e3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:54 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f7ea9b51-c925-436f-8cb3-1951d0ac9740" returned: 0 in 0.506s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:54 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 Feb 27 02:11:54 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-quobyte-f7ea9b51-c925-436f-8cb3-1951d0ac9740" released by "delete_volume" :: held 1.255s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "cinder-quobyte-9c271ece-ed0a-402c-93f2-5da940fd96e3" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-quobyte-9c271ece-ed0a-402c-93f2-5da940fd96e3" acquired by "delete_volume" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4e0a19-0aa3-466b-984f-8b75f37398d3]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c271ece-ed0a-402c-93f2-5da940fd96e3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] Created reservations ['859fff25-f7d7-4de5-8c95-67c8d557b834', '80f4f01f-43a0-4a89-91b6-ccaf62d9d5ae', 'b13410e3-d159-490d-8da2-388839152094', '44d4d457-230c-42f8-a286-0a20daa8ae85'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:54 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:11:54 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:54 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c271ece-ed0a-402c-93f2-5da940fd96e3 Feb 27 02:11:54 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:54 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.453s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:54 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:54 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] Deleted volume successfully. Feb 27 02:11:54 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629" returned: 0 in 0.684s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG cinder.utils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Path /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5050af03-63bf-4485-8292-fa23b76a3fb9 not found in is_blk_device check {{(pid=83231) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5050af03-63bf-4485-8292-fa23b76a3fb9 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c271ece-ed0a-402c-93f2-5da940fd96e3" returned: 0 in 0.562s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c271ece-ed0a-402c-93f2-5da940fd96e3 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:54 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5050af03-63bf-4485-8292-fa23b76a3fb9 Feb 27 02:11:54 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:54 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c271ece-ed0a-402c-93f2-5da940fd96e3 Feb 27 02:11:54 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-b9002de1-2327-4531-91ce-49efe91d1e4e tempest-CreateVolumesFromImageTest-1308120389 None] Lock "cinder-f7ea9b51-c925-436f-8cb3-1951d0ac9740-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:54 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:55 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-9c271ece-ed0a-402c-93f2-5da940fd96e3" returned: 0 in 0.708s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:55 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-quobyte-9c271ece-ed0a-402c-93f2-5da940fd96e3" released by "delete_volume" :: held 1.299s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:55 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Created reservations ['38448d1f-a210-42ca-a092-cb9dce965595', '836fbc7c-f8e7-4ce2-b533-6eb68305793d', '42b89b04-f451-4f8a-a0f8-afdbf45fac97', '57a17081-c7b9-476c-992e-298d897dd01f'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:55 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:55 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:55 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:11:55 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:56 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "cinder-5445101c-812b-4914-af0b-775afe4a8bce-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:56 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-5445101c-812b-4914-af0b-775afe4a8bce-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:56 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "cinder-quobyte-5445101c-812b-4914-af0b-775afe4a8bce" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:56 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-quobyte-5445101c-812b-4914-af0b-775afe4a8bce" acquired by "delete_volume" :: waited 0.037s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:57 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[df38cc86-db6d-43ad-8d7d-33fef5d70bbb]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5445101c-812b-4914-af0b-775afe4a8bce {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:57 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 1.395s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:57 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:57 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Deleted volume successfully. Feb 27 02:11:57 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-742f1149-fb5d-4d51-816e-a80377a2cdfe tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-9c271ece-ed0a-402c-93f2-5da940fd96e3-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:57 devstack sudo[90867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5445101c-812b-4914-af0b-775afe4a8bce Feb 27 02:11:57 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:57 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5050af03-63bf-4485-8292-fa23b76a3fb9" returned: 0 in 2.485s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:57 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[323fbc63-bdc2-468f-bc9a-89e29745daff]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:57 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 Feb 27 02:11:57 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:57 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5445101c-812b-4914-af0b-775afe4a8bce" returned: 0 in 0.777s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:57 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5445101c-812b-4914-af0b-775afe4a8bce {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:57 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5445101c-812b-4914-af0b-775afe4a8bce Feb 27 02:11:57 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:58 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629" returned: 0 in 0.772s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Image conversion details: src /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629, size 1024.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5050af03-63bf-4485-8292-fa23b76a3fb9 {{(pid=83231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:11:58 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Converted 1024.00 MB image at 411.90 MB/s Feb 27 02:11:58 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5050af03-63bf-4485-8292-fa23b76a3fb9 is being set with open permissions: ugo+rw Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5050af03-63bf-4485-8292-fa23b76a3fb9 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:58 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5050af03-63bf-4485-8292-fa23b76a3fb9 Feb 27 02:11:58 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:58 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5445101c-812b-4914-af0b-775afe4a8bce" returned: 0 in 0.578s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-quobyte-5445101c-812b-4914-af0b-775afe4a8bce" released by "delete_volume" :: held 1.424s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Created reservations ['f906f6ed-0241-4f0d-90fb-782d1d12d318', 'a1adeacb-c91d-4fc6-935d-3d9ea20c591c', 'b2eb3a7b-870b-4dab-8937-c59219a562cc', 'dfe6b3b7-5b10-4a9e-ba08-82f7f5a14217'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:58 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:11:58 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:58 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5050af03-63bf-4485-8292-fa23b76a3fb9" returned: 0 in 0.503s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-5050af03-63bf-4485-8292-fa23b76a3fb9" released by "_copy_volume_from_snapshot" :: held 5.144s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-fdf86be5-9562-4be8-9f4c-3b1e865c9e2b-5050af03-63bf-4485-8292-fa23b76a3fb9" released by "_create_volume_from_snapshot" :: held 5.176s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.212s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.854s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-190221066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333329b1-1bdd-4e1a-9181-05585a3aad17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc6e1a1f44c4728a2eeef47d042f47b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:54Z,use_quota=True,user_id='c272771bf9984346b9593eb4b2c71436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Creating volume 333329b1-1bdd-4e1a-9181-05585a3aad17 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:58 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f2d939-0006-4af6-822e-37ea89a96aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5050af03-63bf-4485-8292-fa23b76a3fb9', 'volume_size': 1, 'snapshot_id': 'fdf86be5-9562-4be8-9f4c-3b1e865c9e2b'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e848e2c4-752a-4663-8e04-5ead3e915662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:58 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 1073741824 Feb 27 02:11:58 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:58 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Volume volume-5050af03-63bf-4485-8292-fa23b76a3fb9 (5050af03-63bf-4485-8292-fa23b76a3fb9): created successfully Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e848e2c4-752a-4663-8e04-5ead3e915662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Flow 'volume_create_manager' (0934baca-8081-477a-922c-2501ba98bec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Flow 'volume_create_manager' (7cbc0edf-827f-442b-9caa-acb117d4f28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb15b09a-91a4-4c4a-bd80-88efcb3fbb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb15b09a-91a4-4c4a-bd80-88efcb3fbb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2094872265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88500fae-4b03-49bd-af78-241d69084c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae639520c49b3938224c08e331c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:59Z,use_quota=True,user_id='2c9c6411e38f4711839c493755e30b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a19894-deb6-4213-af7a-2eab6f0a0511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a19894-deb6-4213-af7a-2eab6f0a0511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62e6407-e1eb-4bcd-99ce-e4ec712b65cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62e6407-e1eb-4bcd-99ce-e4ec712b65cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88500fae-4b03-49bd-af78-241d69084c9f', 'volume_name': 'volume-88500fae-4b03-49bd-af78-241d69084c9f', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc8d94f-fe3a-4267-b235-b7836522552b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc8d94f-fe3a-4267-b235-b7836522552b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2f5ca7-6a68-4194-b391-3337f4b48094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:58 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Volume 88500fae-4b03-49bd-af78-241d69084c9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88500fae-4b03-49bd-af78-241d69084c9f', 'volume_size': 1} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:58 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-cca3e942-3b2b-49a8-bb1c-5e6212d3be3e tempest-VolumeDependencyTests-122603111 None] Created volume successfully. Feb 27 02:11:58 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.470s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:58 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Deleted volume successfully. Feb 27 02:11:58 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-8a198bc5-b145-4a8a-bfc3-9706fdc48510 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-5445101c-812b-4914-af0b-775afe4a8bce-delete_volume" released by "delete_volume" :: held 2.132s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "cinder-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "cinder-quobyte-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-quobyte-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f" acquired by "delete_volume" :: waited 0.023s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[46910589-194c-4ec6-ae46-b53e42be3a9a]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:59 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f Feb 27 02:11:59 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:59 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 1073741824" returned: 0 in 0.684s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:59 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 Feb 27 02:11:59 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "cinder-fdf86be5-9562-4be8-9f4c-3b1e865c9e2b-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-fdf86be5-9562-4be8-9f4c-3b1e865c9e2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "cinder-quobyte-20596bf3-70b1-498e-bc98-002c2fb38629" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-20596bf3-70b1-498e-bc98-002c2fb38629" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "cinder-quobyte-fdf86be5-9562-4be8-9f4c-3b1e865c9e2b" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-fdf86be5-9562-4be8-9f4c-3b1e865c9e2b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] Deleting offline snapshot fdf86be5-9562-4be8-9f4c-3b1e865c9e2b of volume 20596bf3-70b1-498e-bc98-002c2fb38629 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] snapshot_file for this snap is: volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa25ea1-4038-4236-88d4-3e2e0a344c38]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:59 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b Feb 27 02:11:59 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:59 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f" returned: 0 in 0.561s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:59 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f Feb 27 02:11:59 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:59 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17" returned: 0 in 0.416s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.998s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2094872265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88500fae-4b03-49bd-af78-241d69084c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae639520c49b3938224c08e331c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:59Z,use_quota=True,user_id='2c9c6411e38f4711839c493755e30b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Creating volume 88500fae-4b03-49bd-af78-241d69084c9f {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:59 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f05afd5-7b67-4463-a1ac-4ff4e981385e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-333329b1-1bdd-4e1a-9181-05585a3aad17', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:59 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f 1073741824 Feb 27 02:11:59 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adcd3d6f-2816-4d75-938a-a57af27c8774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:59 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Volume volume-333329b1-1bdd-4e1a-9181-05585a3aad17 (333329b1-1bdd-4e1a-9181-05585a3aad17): created successfully Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adcd3d6f-2816-4d75-938a-a57af27c8774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Flow 'volume_create_manager' (4090dbf0-d9b3-4127-b227-479f63f6e769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:59 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-5ecf8b43-3fc9-49af-9ab6-1953e78d0bef tempest-SnapshotDependencyTests-1072117580 None] Created volume successfully. Feb 27 02:11:59 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b" returned: 0 in 0.505s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20596bf3-70b1-498e-bc98-002c2fb38629(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4807c194-6729-443d-b45e-a289bc343425]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:59 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:00 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 Feb 27 02:12:00 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:00 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f" returned: 0 in 0.439s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-quobyte-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f" released by "delete_volume" :: held 1.022s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Created reservations ['1c86f0fc-eb9a-4bc5-9116-5d89039c5607', '7ee1adc4-eddc-4dbf-bb3f-4413355be287', 'dd10f332-9966-4f0e-b963-1f489bae7ea3', '601e932a-0146-4ff9-a487-28be49f1f058'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:00 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:12:00 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:00 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f 1073741824" returned: 0 in 0.554s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:00 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f Feb 27 02:12:00 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d780747b-dda2-476e-9384-ce62b1a6fcf1 tempest-SnapshotDependencyTests-1072117580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:00 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629" returned: 0 in 0.583s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:00 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b Feb 27 02:12:00 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:00 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.470s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:00 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Deleted volume successfully. Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ba6d79cf-756a-49ba-b650-05917410f86b tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-7fd0bd01-e4bd-4ac2-a688-1eaa706e082f-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:00 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f" returned: 0 in 0.435s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d780747b-dda2-476e-9384-ce62b1a6fcf1 tempest-SnapshotDependencyTests-1072117580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.324s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-d780747b-dda2-476e-9384-ce62b1a6fcf1 tempest-SnapshotDependencyTests-1072117580 None] Creating offline snapshot 6797d4ca-1b4b-4f76-a269-9a3d229850c2 of volume 333329b1-1bdd-4e1a-9181-05585a3aad17 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2f5ca7-6a68-4194-b391-3337f4b48094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88500fae-4b03-49bd-af78-241d69084c9f', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c0f6d5-e444-4c7e-870e-02876fe700b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba357056-f748-46ad-a3b5-f59c99a1a1b3]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d780747b-dda2-476e-9384-ce62b1a6fcf1 tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:00 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Volume volume-88500fae-4b03-49bd-af78-241d69084c9f (88500fae-4b03-49bd-af78-241d69084c9f): created successfully Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c0f6d5-e444-4c7e-870e-02876fe700b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:00 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Flow 'volume_create_manager' (7cbc0edf-827f-442b-9caa-acb117d4f28a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:00 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-14b10fe2-e5cb-4560-9002-be0fed3257ea tempest-CreateVolumesFromSnapshotTest-378714314 None] Created volume successfully. Feb 27 02:12:00 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 Feb 27 02:12:00 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:01 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b" returned: 0 in 0.464s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:01 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b Feb 27 02:12:01 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "cinder-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "cinder-quobyte-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-quobyte-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261" acquired by "delete_volume" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:01 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[80eec9d7-eb86-4848-b206-b50f431638f3]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:01 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d780747b-dda2-476e-9384-ce62b1a6fcf1 tempest-SnapshotDependencyTests-1072117580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17" returned: 0 in 0.532s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d780747b-dda2-476e-9384-ce62b1a6fcf1 tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:01 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261 Feb 27 02:12:01 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:01 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2 1G Feb 27 02:12:01 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:01 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629.fdf86be5-9562-4be8-9f4c-3b1e865c9e2b" returned: 0 in 0.424s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-fdf86be5-9562-4be8-9f4c-3b1e865c9e2b" released by "_delete_snapshot" :: held 2.031s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-20596bf3-70b1-498e-bc98-002c2fb38629" released by "delete_snapshot" :: held 2.043s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:01 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] Created reservations ['49b528f7-9203-47a4-b1b3-6e661cd75c6f', '7c75280b-d8d5-47f2-ac85-7138734f29b4', '6caf0bdf-2b01-41a0-b874-f53b7c8026a2', '93fa156e-8866-46aa-b33e-9ff89d56cf9b'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:01 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] Delete snapshot completed successfully. Feb 27 02:12:01 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2a1e6632-2eba-402a-9eb1-fd4dc02e4875 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-fdf86be5-9562-4be8-9f4c-3b1e865c9e2b-delete_snapshot" released by "delete_snapshot" :: held 2.136s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:01 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261" returned: 0 in 0.543s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:01 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261 Feb 27 02:12:01 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:01 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d780747b-dda2-476e-9384-ce62b1a6fcf1 tempest-SnapshotDependencyTests-1072117580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2 1G" returned: 0 in 0.521s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:01 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d780747b-dda2-476e-9384-ce62b1a6fcf1 tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-333329b1-1bdd-4e1a-9181-05585a3aad17 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:01 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-333329b1-1bdd-4e1a-9181-05585a3aad17 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2 Feb 27 02:12:01 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7b229e8f-7632-4943-8076-65bb8cd1a5a5 tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:02 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261" returned: 0 in 0.426s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-quobyte-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261" released by "delete_volume" :: held 0.989s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Created reservations ['31c1dddf-4e92-4a45-a3a7-0557c7277b32', '370741f7-d0de-49c4-b339-ee10b7dc762c', '46c61fbd-a147-439d-8362-7c8e98a790bd', 'd75bd763-6929-4ba1-b8e9-0c796b8a4a9b'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:02 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d780747b-dda2-476e-9384-ce62b1a6fcf1 tempest-SnapshotDependencyTests-1072117580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-333329b1-1bdd-4e1a-9181-05585a3aad17 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2" returned: 0 in 0.451s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:02 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-d780747b-dda2-476e-9384-ce62b1a6fcf1 tempest-SnapshotDependencyTests-1072117580 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2 is being set with open permissions: ugo+rw Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d780747b-dda2-476e-9384-ce62b1a6fcf1 tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:02 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2 Feb 27 02:12:02 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:02 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:12:02 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "cinder-20596bf3-70b1-498e-bc98-002c2fb38629-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-20596bf3-70b1-498e-bc98-002c2fb38629-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "cinder-quobyte-20596bf3-70b1-498e-bc98-002c2fb38629" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-20596bf3-70b1-498e-bc98-002c2fb38629" acquired by "delete_volume" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[422464a1-8bc4-497c-9b0f-8dbfe3cbe884]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:02 devstack sudo[90964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 Feb 27 02:12:02 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:02 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d780747b-dda2-476e-9384-ce62b1a6fcf1 tempest-SnapshotDependencyTests-1072117580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2" returned: 0 in 0.435s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d780747b-dda2-476e-9384-ce62b1a6fcf1 tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:02 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.info Feb 27 02:12:02 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:02 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.443s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:02 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Deleted volume successfully. Feb 27 02:12:02 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-2c5bbd04-2737-4af8-bbe0-1cf9187daa83 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-0c6b1d9f-05dd-4899-b4bc-c8e3eb8df261-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:03 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629" returned: 0 in 0.476s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:03 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629 Feb 27 02:12:03 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:03 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d780747b-dda2-476e-9384-ce62b1a6fcf1 tempest-SnapshotDependencyTests-1072117580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.info" returned: 0 in 0.414s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:03 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-d780747b-dda2-476e-9384-ce62b1a6fcf1 tempest-SnapshotDependencyTests-1072117580 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.info is being set with open permissions: ugo+rw Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d780747b-dda2-476e-9384-ce62b1a6fcf1 tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:03 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.info Feb 27 02:12:03 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "cinder-920814b0-14b6-49a4-b7d3-f62be723c0cc-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-920814b0-14b6-49a4-b7d3-f62be723c0cc-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "cinder-quobyte-920814b0-14b6-49a4-b7d3-f62be723c0cc" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-quobyte-920814b0-14b6-49a4-b7d3-f62be723c0cc" acquired by "delete_volume" :: waited 0.007s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:03 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-20596bf3-70b1-498e-bc98-002c2fb38629" returned: 0 in 0.435s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[872d91e8-1e32-4067-9d44-a1b078ffae84]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-920814b0-14b6-49a4-b7d3-f62be723c0cc {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-20596bf3-70b1-498e-bc98-002c2fb38629" released by "delete_volume" :: held 0.959s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] Created reservations ['f0d6cb11-a257-45e6-b8e1-451e0317da2c', 'f2ab6aa3-af44-4312-b0c2-bcd22e621b2a', '62c73959-a93b-431c-9a41-01d3ef3bd600', '192bfba9-3304-4197-8a00-98c79d99ca47'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:03 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-920814b0-14b6-49a4-b7d3-f62be723c0cc Feb 27 02:12:03 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:03 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:12:03 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:03 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-d780747b-dda2-476e-9384-ce62b1a6fcf1 tempest-SnapshotDependencyTests-1072117580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.info" returned: 0 in 0.457s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-d780747b-dda2-476e-9384-ce62b1a6fcf1 tempest-SnapshotDependencyTests-1072117580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.874s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7b229e8f-7632-4943-8076-65bb8cd1a5a5 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.699s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-7b229e8f-7632-4943-8076-65bb8cd1a5a5 tempest-CreateVolumesFromSnapshotTest-378714314 None] Creating offline snapshot 72140d14-1488-4704-9d86-e4a940de5a0f of volume 88500fae-4b03-49bd-af78-241d69084c9f {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b62ba43-ff01-4a05-8bb6-0e64d19f9919]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7b229e8f-7632-4943-8076-65bb8cd1a5a5 tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:03 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-d780747b-dda2-476e-9384-ce62b1a6fcf1 tempest-SnapshotDependencyTests-1072117580 None] Create snapshot completed successfully Feb 27 02:12:03 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f Feb 27 02:12:03 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Flow 'volume_create_manager' (caf69ceb-6dbc-4a65-9260-591487bbf19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1960536-64ba-4c22-9751-97d25ae14336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1960536-64ba-4c22-9751-97d25ae14336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1690357726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79a45d7-f7cf-40df-8677-ffa2c7cc5c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19623f2833a46289359171814e5cd06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:04Z,use_quota=True,user_id='540e415eaaa64fe582a95ccd3188fcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6140d8-9964-44e8-a789-0c9f98f2b64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6140d8-9964-44e8-a789-0c9f98f2b64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:03 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df93d8ef-20a8-421d-8746-f3f58a2aa94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df93d8ef-20a8-421d-8746-f3f58a2aa94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f79a45d7-f7cf-40df-8677-ffa2c7cc5c78', 'volume_name': 'volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0094c6-c97e-42ff-9ac1-268547870093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0094c6-c97e-42ff-9ac1-268547870093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60864c5d-b70f-4250-b193-e9aa71ea968e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:04 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Volume f79a45d7-f7cf-40df-8677-ffa2c7cc5c78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78', 'volume_size': 1} Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:04 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-920814b0-14b6-49a4-b7d3-f62be723c0cc" returned: 0 in 0.533s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-920814b0-14b6-49a4-b7d3-f62be723c0cc {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:04 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-920814b0-14b6-49a4-b7d3-f62be723c0cc Feb 27 02:12:04 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:04 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.477s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:04 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] Deleted volume successfully. Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-4f6f2fea-917b-4003-bc24-fbedce7d72d9 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-20596bf3-70b1-498e-bc98-002c2fb38629-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:04 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7b229e8f-7632-4943-8076-65bb8cd1a5a5 tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f" returned: 0 in 0.541s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7b229e8f-7632-4943-8076-65bb8cd1a5a5 tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:04 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f 1G Feb 27 02:12:04 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:04 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-920814b0-14b6-49a4-b7d3-f62be723c0cc" returned: 0 in 0.412s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-quobyte-920814b0-14b6-49a4-b7d3-f62be723c0cc" released by "delete_volume" :: held 0.971s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Created reservations ['31459965-213d-47da-ba43-67c39a40db20', '654ec687-cf50-44e6-a53f-e72bde47457b', 'a836c31e-5e76-4df7-894b-ca4621e67d0a', '8cc286d7-b2cc-4755-9ae9-91a0d7e50b01'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:04 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:12:04 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:04 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7b229e8f-7632-4943-8076-65bb8cd1a5a5 tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f 1G" returned: 0 in 0.485s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:04 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7b229e8f-7632-4943-8076-65bb8cd1a5a5 tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88500fae-4b03-49bd-af78-241d69084c9f -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:04 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88500fae-4b03-49bd-af78-241d69084c9f -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f Feb 27 02:12:04 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Flow 'volume_create_manager' (f38ab5b4-a272-4050-898f-4aa45a596175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb155a7-dc1f-49f6-98a1-197f4827fc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:05 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb155a7-dc1f-49f6-98a1-197f4827fc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=763a316d-40be-40fe-ac86-c58fb1c48081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc6e1a1f44c4728a2eeef47d042f47b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6797d4ca-1b4b-4f76-a269-9a3d229850c2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:05Z,use_quota=True,user_id='c272771bf9984346b9593eb4b2c71436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3d5325-aaea-4736-b15b-a32013492a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3d5325-aaea-4736-b15b-a32013492a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfc699f-1929-41ff-9be4-42072c9a459a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfc699f-1929-41ff-9be4-42072c9a459a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '763a316d-40be-40fe-ac86-c58fb1c48081', 'volume_name': 'volume-763a316d-40be-40fe-ac86-c58fb1c48081', 'volume_size': 1, 'snapshot_id': '6797d4ca-1b4b-4f76-a269-9a3d229850c2'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6902e3ca-8a20-4554-9e89-c0edafcdad65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6902e3ca-8a20-4554-9e89-c0edafcdad65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1c32da-432f-475f-b645-450181684be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:05 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Volume 763a316d-40be-40fe-ac86-c58fb1c48081: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-763a316d-40be-40fe-ac86-c58fb1c48081', 'volume_size': 1, 'snapshot_id': '6797d4ca-1b4b-4f76-a269-9a3d229850c2'} Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.516s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:05 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Deleted volume successfully. Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c4a23fc2-2336-4a62-aa05-42bcc5de9ff1 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-920814b0-14b6-49a4-b7d3-f62be723c0cc-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:05 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7b229e8f-7632-4943-8076-65bb8cd1a5a5 tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88500fae-4b03-49bd-af78-241d69084c9f -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f" returned: 0 in 0.472s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:05 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-7b229e8f-7632-4943-8076-65bb8cd1a5a5 tempest-CreateVolumesFromSnapshotTest-378714314 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f is being set with open permissions: ugo+rw Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7b229e8f-7632-4943-8076-65bb8cd1a5a5 tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:05 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f Feb 27 02:12:05 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "cinder-d966bd22-87c8-431c-b857-5f7eb06923f1-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-d966bd22-87c8-431c-b857-5f7eb06923f1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "cinder-quobyte-d966bd22-87c8-431c-b857-5f7eb06923f1" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-quobyte-d966bd22-87c8-431c-b857-5f7eb06923f1" acquired by "delete_volume" :: waited 0.016s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4d119e-f69b-47b1-a6df-4d15a4a7dd7d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d966bd22-87c8-431c-b857-5f7eb06923f1 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:05 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7b229e8f-7632-4943-8076-65bb8cd1a5a5 tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f" returned: 0 in 0.410s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:05 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7b229e8f-7632-4943-8076-65bb8cd1a5a5 tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:05 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.info Feb 27 02:12:05 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:05 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d966bd22-87c8-431c-b857-5f7eb06923f1 Feb 27 02:12:05 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:06 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7b229e8f-7632-4943-8076-65bb8cd1a5a5 tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.info" returned: 0 in 0.384s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:06 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-7b229e8f-7632-4943-8076-65bb8cd1a5a5 tempest-CreateVolumesFromSnapshotTest-378714314 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.info is being set with open permissions: ugo+rw Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7b229e8f-7632-4943-8076-65bb8cd1a5a5 tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:06 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.info Feb 27 02:12:06 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:06 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d966bd22-87c8-431c-b857-5f7eb06923f1" returned: 0 in 0.480s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d966bd22-87c8-431c-b857-5f7eb06923f1 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:06 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d966bd22-87c8-431c-b857-5f7eb06923f1 Feb 27 02:12:06 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:06 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-7b229e8f-7632-4943-8076-65bb8cd1a5a5 tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.info" returned: 0 in 0.386s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-7b229e8f-7632-4943-8076-65bb8cd1a5a5 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.748s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.475s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1690357726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79a45d7-f7cf-40df-8677-ffa2c7cc5c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19623f2833a46289359171814e5cd06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:04Z,use_quota=True,user_id='540e415eaaa64fe582a95ccd3188fcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Creating volume f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:06 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:06 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-7b229e8f-7632-4943-8076-65bb8cd1a5a5 tempest-CreateVolumesFromSnapshotTest-378714314 None] Create snapshot completed successfully Feb 27 02:12:06 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 1073741824 Feb 27 02:12:06 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:06 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-d966bd22-87c8-431c-b857-5f7eb06923f1" returned: 0 in 0.391s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-quobyte-d966bd22-87c8-431c-b857-5f7eb06923f1" released by "delete_volume" :: held 0.891s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Created reservations ['d48bee77-5124-430f-b04b-194f88ab3a18', '450335ac-ba21-4a2c-a67c-bba276010676', '00bc36ce-aac9-4e4b-9edb-7d41b7ff6d0a', '53441bf7-da69-4a58-ab80-5d5979fd5a95'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:06 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:06 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:12:06 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:07 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 1073741824" returned: 0 in 0.542s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:07 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.428s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:07 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Deleted volume successfully. Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1b3d3753-ac89-412e-b3fe-9983584acf80 tempest-CreateVolumesFromSourceVolumeTest-1370081208 None] Lock "cinder-d966bd22-87c8-431c-b857-5f7eb06923f1-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:07 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 Feb 27 02:12:07 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Flow 'volume_create_manager' (8406e63e-b003-4a1c-9e24-7ce6864d5519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9806c3-3b01-4129-9f34-4a2ac82f5500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9806c3-3b01-4129-9f34-4a2ac82f5500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-285685209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd186b3-8180-45d2-a11e-7bbe841de04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae639520c49b3938224c08e331c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:07Z,use_quota=True,user_id='2c9c6411e38f4711839c493755e30b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05de731a-a028-4236-9261-1c424a3c4844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05de731a-a028-4236-9261-1c424a3c4844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8375fbc5-f7ed-41c4-b85b-014101009a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8375fbc5-f7ed-41c4-b85b-014101009a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efd186b3-8180-45d2-a11e-7bbe841de04a', 'volume_name': 'volume-efd186b3-8180-45d2-a11e-7bbe841de04a', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f77810a-b1f1-49ed-90a7-63fd64f2d988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f77810a-b1f1-49ed-90a7-63fd64f2d988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eeafe3c-a86f-4d12-bfc7-e0d351872b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Volume efd186b3-8180-45d2-a11e-7bbe841de04a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efd186b3-8180-45d2-a11e-7bbe841de04a', 'volume_size': 1} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78" returned: 0 in 0.493s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.481s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Acquiring lock "cinder-quobyte-6797d4ca-1b4b-4f76-a269-9a3d229850c2-763a316d-40be-40fe-ac86-c58fb1c48081" by "_create_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60864c5d-b70f-4250-b193-e9aa71ea968e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d9e180-c251-42e7-ac05-99d9d4807274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Lock "cinder-quobyte-6797d4ca-1b4b-4f76-a269-9a3d229850c2-763a316d-40be-40fe-ac86-c58fb1c48081" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Creating volume 763a316d-40be-40fe-ac86-c58fb1c48081 from snapshot 6797d4ca-1b4b-4f76-a269-9a3d229850c2 {{(pid=83231) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Acquiring lock "cinder-quobyte-763a316d-40be-40fe-ac86-c58fb1c48081" by "_copy_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:07 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Volume volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 (f79a45d7-f7cf-40df-8677-ffa2c7cc5c78): created successfully Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d9e180-c251-42e7-ac05-99d9d4807274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Flow 'volume_create_manager' (caf69ceb-6dbc-4a65-9260-591487bbf19e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:07 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-bcd8fa78-c09f-4b86-a342-120fe1e482f1 tempest-VolumeDependencyTests-122603111 None] Created volume successfully. Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Lock "cinder-quobyte-763a316d-40be-40fe-ac86-c58fb1c48081" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] snapshot: 6797d4ca-1b4b-4f76-a269-9a3d229850c2, volume: 763a316d-40be-40fe-ac86-c58fb1c48081, {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f8869f-3298-4376-bc84-f6d233f7f7fe]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:07 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2 Feb 27 02:12:07 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Flow 'volume_create_manager' (d0500065-e78d-4e83-9ea5-d4ff9702b897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3a407d-83c4-4862-9d0e-f296756a5a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3a407d-83c4-4862-9d0e-f296756a5a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1025052267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb9efe5-e7b2-4a03-b4a1-2575af62f687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae639520c49b3938224c08e331c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:08Z,use_quota=True,user_id='2c9c6411e38f4711839c493755e30b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c9e06a-f352-4fd7-a47a-bb5e5fb6ba8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c9e06a-f352-4fd7-a47a-bb5e5fb6ba8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d093b9a-cc9f-4a0c-919f-a95eadae9086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d093b9a-cc9f-4a0c-919f-a95eadae9086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cb9efe5-e7b2-4a03-b4a1-2575af62f687', 'volume_name': 'volume-3cb9efe5-e7b2-4a03-b4a1-2575af62f687', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836dffd7-e71a-48f3-9129-bdd83aa555d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836dffd7-e71a-48f3-9129-bdd83aa555d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a7a6d0-4ebe-4f91-a753-4fb831344193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Volume 3cb9efe5-e7b2-4a03-b4a1-2575af62f687: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cb9efe5-e7b2-4a03-b4a1-2575af62f687', 'volume_size': 1} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Flow 'volume_create_manager' (740dc3d2-577c-48cb-84ed-8b35ffc4d221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106fd5e6-6df6-4200-9e95-a2be5940ac11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106fd5e6-6df6-4200-9e95-a2be5940ac11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1478600297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825ea79e-655f-4e46-bcc9-0b77fd324652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae639520c49b3938224c08e331c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:08Z,use_quota=True,user_id='2c9c6411e38f4711839c493755e30b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b9843b-15b4-4afe-9ca4-c31075168f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b9843b-15b4-4afe-9ca4-c31075168f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae0cffb-a1f8-42ff-8eb5-e96303c67467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae0cffb-a1f8-42ff-8eb5-e96303c67467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '825ea79e-655f-4e46-bcc9-0b77fd324652', 'volume_name': 'volume-825ea79e-655f-4e46-bcc9-0b77fd324652', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afcd3613-54c6-430a-a9ba-3b302431f98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afcd3613-54c6-430a-a9ba-3b302431f98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0bfe46-758f-43be-b226-2663242429ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Volume 825ea79e-655f-4e46-bcc9-0b77fd324652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-825ea79e-655f-4e46-bcc9-0b77fd324652', 'volume_size': 1} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Flow 'volume_create_manager' (390f08cc-7d3b-4946-b1a6-c584d9d600d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97b3d25-d8ea-41ff-9cd0-62f3c6796766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97b3d25-d8ea-41ff-9cd0-62f3c6796766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1411713874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6be6dd1-fe14-41cf-9f0d-0be4b0709212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae639520c49b3938224c08e331c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:08Z,use_quota=True,user_id='2c9c6411e38f4711839c493755e30b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3b99e2-e42d-4b13-ba51-a294292d4c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3b99e2-e42d-4b13-ba51-a294292d4c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9689b3b-9d68-493f-8aab-207450803641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9689b3b-9d68-493f-8aab-207450803641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6be6dd1-fe14-41cf-9f0d-0be4b0709212', 'volume_name': 'volume-e6be6dd1-fe14-41cf-9f0d-0be4b0709212', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1f6d6a-73cf-428b-b5f4-cb95092c5fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1f6d6a-73cf-428b-b5f4-cb95092c5fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1f69bf-744f-46c5-821d-fe4cae9ec9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Volume e6be6dd1-fe14-41cf-9f0d-0be4b0709212: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6be6dd1-fe14-41cf-9f0d-0be4b0709212', 'volume_size': 1} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:08 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2" returned: 0 in 0.687s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-333329b1-1bdd-4e1a-9181-05585a3aad17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Creating direct copy from snapshot {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2f143d-cfbb-43bf-a659-7cdfe0026bca]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Flow 'volume_create_manager' (993d98f6-780a-4040-92c6-f551e82e1936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364444f7-0da6-41e4-9629-46a004b2cee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 Feb 27 02:12:08 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364444f7-0da6-41e4-9629-46a004b2cee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1886022453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d58360-374f-45f8-af0f-8c2f05cb3d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae639520c49b3938224c08e331c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:08Z,use_quota=True,user_id='2c9c6411e38f4711839c493755e30b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28342b4a-6d08-486e-9392-0786ac19fe42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28342b4a-6d08-486e-9392-0786ac19fe42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46155730-75d9-48e4-9d20-d4196360cfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46155730-75d9-48e4-9d20-d4196360cfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48d58360-374f-45f8-af0f-8c2f05cb3d49', 'volume_name': 'volume-48d58360-374f-45f8-af0f-8c2f05cb3d49', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5301fe63-8c5b-4ebe-afef-d17d5a3a962e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5301fe63-8c5b-4ebe-afef-d17d5a3a962e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c288ccd-c6ff-4130-b1cb-620da358437b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Volume 48d58360-374f-45f8-af0f-8c2f05cb3d49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48d58360-374f-45f8-af0f-8c2f05cb3d49', 'volume_size': 1} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Flow 'volume_create_manager' (495db50c-5d7f-48d4-95cb-523dc0046f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966d2164-3b52-4141-9c2c-6ee1b2f11c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966d2164-3b52-4141-9c2c-6ee1b2f11c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-403659511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32704ee0-5a6e-49e8-a688-5b72290504a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19623f2833a46289359171814e5cd06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f79a45d7-f7cf-40df-8677-ffa2c7cc5c78,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:09Z,use_quota=True,user_id='540e415eaaa64fe582a95ccd3188fcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636462ef-425b-41ca-8771-e78a86807092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636462ef-425b-41ca-8771-e78a86807092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2535dd3-8dd7-40dd-b153-b135bd9d4e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2535dd3-8dd7-40dd-b153-b135bd9d4e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '32704ee0-5a6e-49e8-a688-5b72290504a6', 'volume_name': 'volume-32704ee0-5a6e-49e8-a688-5b72290504a6', 'volume_size': 1, 'source_volid': 'f79a45d7-f7cf-40df-8677-ffa2c7cc5c78', 'source_volstatus': 'available'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d5c5a2-b4a9-4263-9e3f-e085892523b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d5c5a2-b4a9-4263-9e3f-e085892523b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d76848-27bc-4a40-bab6-7533335cf584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Volume 32704ee0-5a6e-49e8-a688-5b72290504a6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-32704ee0-5a6e-49e8-a688-5b72290504a6', 'volume_size': 1, 'source_volid': 'f79a45d7-f7cf-40df-8677-ffa2c7cc5c78', 'source_volstatus': 'available'} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Flow 'volume_create_manager' (7d46cd1c-144d-44f2-9eba-25210a1cc66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adbab712-29b0-40d4-913b-5e8bca6c958b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adbab712-29b0-40d4-913b-5e8bca6c958b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4d482e-043c-4907-b600-98acd7a3bb22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e18d8dd4974313bd809261c7efb279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:09Z,use_quota=True,user_id='52655a2672c34e1eabc252116185edbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe68f55-aee6-441c-af93-ed20ba5c3271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe68f55-aee6-441c-af93-ed20ba5c3271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb90c69-adad-4a1e-9a8d-1f4ad2420cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb90c69-adad-4a1e-9a8d-1f4ad2420cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f4d482e-043c-4907-b600-98acd7a3bb22', 'volume_name': 'volume-7f4d482e-043c-4907-b600-98acd7a3bb22', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394fa1e1-1f5f-4cd4-bb20-1a56a5110acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394fa1e1-1f5f-4cd4-bb20-1a56a5110acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a247ffec-1627-4b2e-b5ef-07d5f1c5dc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Volume 7f4d482e-043c-4907-b600-98acd7a3bb22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f4d482e-043c-4907-b600-98acd7a3bb22', 'volume_size': 1} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:08 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17" returned: 0 in 0.501s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG cinder.utils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Path /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-763a316d-40be-40fe-ac86-c58fb1c48081 not found in is_blk_device check {{(pid=83231) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:12:08 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-763a316d-40be-40fe-ac86-c58fb1c48081 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:08 devstack sudo[91048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-763a316d-40be-40fe-ac86-c58fb1c48081 Feb 27 02:12:08 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:10 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-763a316d-40be-40fe-ac86-c58fb1c48081" returned: 0 in 1.951s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:10 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f273a5-f6c1-4051-8a08-7c0c7d78dbb5]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:10 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:10 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 Feb 27 02:12:10 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:11 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17" returned: 0 in 0.562s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Image conversion details: src /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17, size 1024.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-763a316d-40be-40fe-ac86-c58fb1c48081 {{(pid=83231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:12:11 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Converted 1024.00 MB image at 524.44 MB/s Feb 27 02:12:11 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-763a316d-40be-40fe-ac86-c58fb1c48081 is being set with open permissions: ugo+rw Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-763a316d-40be-40fe-ac86-c58fb1c48081 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:11 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-763a316d-40be-40fe-ac86-c58fb1c48081 Feb 27 02:12:11 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:11 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-763a316d-40be-40fe-ac86-c58fb1c48081" returned: 0 in 0.385s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Lock "cinder-quobyte-763a316d-40be-40fe-ac86-c58fb1c48081" released by "_copy_volume_from_snapshot" :: held 4.153s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Lock "cinder-quobyte-6797d4ca-1b4b-4f76-a269-9a3d229850c2-763a316d-40be-40fe-ac86-c58fb1c48081" released by "_create_volume_from_snapshot" :: held 4.193s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.218s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.229s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-285685209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd186b3-8180-45d2-a11e-7bbe841de04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae639520c49b3938224c08e331c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:07Z,use_quota=True,user_id='2c9c6411e38f4711839c493755e30b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Creating volume efd186b3-8180-45d2-a11e-7bbe841de04a {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:11 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-efd186b3-8180-45d2-a11e-7bbe841de04a 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:11 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-efd186b3-8180-45d2-a11e-7bbe841de04a 1073741824 Feb 27 02:12:11 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1c32da-432f-475f-b645-450181684be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-763a316d-40be-40fe-ac86-c58fb1c48081', 'volume_size': 1, 'snapshot_id': '6797d4ca-1b4b-4f76-a269-9a3d229850c2'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb139fff-ddf4-4543-b7e4-d9f85680d84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:11 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Volume volume-763a316d-40be-40fe-ac86-c58fb1c48081 (763a316d-40be-40fe-ac86-c58fb1c48081): created successfully Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb139fff-ddf4-4543-b7e4-d9f85680d84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:11 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Flow 'volume_create_manager' (f38ab5b4-a272-4050-898f-4aa45a596175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:11 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-35a6350c-fdec-4190-b922-6497615e6437 tempest-SnapshotDependencyTests-1072117580 None] Created volume successfully. Feb 27 02:12:12 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-efd186b3-8180-45d2-a11e-7bbe841de04a 1073741824" returned: 0 in 0.458s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-efd186b3-8180-45d2-a11e-7bbe841de04a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:12 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-efd186b3-8180-45d2-a11e-7bbe841de04a Feb 27 02:12:12 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] Acquiring lock "cinder-6797d4ca-1b4b-4f76-a269-9a3d229850c2-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] Lock "cinder-6797d4ca-1b4b-4f76-a269-9a3d229850c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] Acquiring lock "cinder-quobyte-333329b1-1bdd-4e1a-9181-05585a3aad17" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] Lock "cinder-quobyte-333329b1-1bdd-4e1a-9181-05585a3aad17" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] Acquiring lock "cinder-quobyte-6797d4ca-1b4b-4f76-a269-9a3d229850c2" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] Lock "cinder-quobyte-6797d4ca-1b4b-4f76-a269-9a3d229850c2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] Deleting offline snapshot 6797d4ca-1b4b-4f76-a269-9a3d229850c2 of volume 333329b1-1bdd-4e1a-9181-05585a3aad17 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] snapshot_file for this snap is: volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac5790f-5156-4b54-bd62-b82e202a6468]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:12 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2 Feb 27 02:12:12 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:12 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-efd186b3-8180-45d2-a11e-7bbe841de04a" returned: 0 in 0.393s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.852s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1025052267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb9efe5-e7b2-4a03-b4a1-2575af62f687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae639520c49b3938224c08e331c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:08Z,use_quota=True,user_id='2c9c6411e38f4711839c493755e30b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Creating volume 3cb9efe5-e7b2-4a03-b4a1-2575af62f687 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:12 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3cb9efe5-e7b2-4a03-b4a1-2575af62f687 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eeafe3c-a86f-4d12-bfc7-e0d351872b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efd186b3-8180-45d2-a11e-7bbe841de04a', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:12 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3cb9efe5-e7b2-4a03-b4a1-2575af62f687 1073741824 Feb 27 02:12:12 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c4c133-ed9e-4944-9f3b-185741565d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:12 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Volume volume-efd186b3-8180-45d2-a11e-7bbe841de04a (efd186b3-8180-45d2-a11e-7bbe841de04a): created successfully Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c4c133-ed9e-4944-9f3b-185741565d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:12 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Flow 'volume_create_manager' (8406e63e-b003-4a1c-9e24-7ce6864d5519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:12 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-92b83afb-c639-494d-901a-478acb6cfa63 tempest-CreateVolumesFromSnapshotTest-378714314 None] Created volume successfully. Feb 27 02:12:13 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2" returned: 0 in 0.474s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-333329b1-1bdd-4e1a-9181-05585a3aad17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab3238f-e28b-4e90-9acb-2813b2efb626]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:13 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 Feb 27 02:12:13 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:13 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3cb9efe5-e7b2-4a03-b4a1-2575af62f687 1073741824" returned: 0 in 0.469s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3cb9efe5-e7b2-4a03-b4a1-2575af62f687 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:13 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3cb9efe5-e7b2-4a03-b4a1-2575af62f687 Feb 27 02:12:13 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:13 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17" returned: 0 in 0.486s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:13 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2 Feb 27 02:12:13 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:13 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3cb9efe5-e7b2-4a03-b4a1-2575af62f687" returned: 0 in 0.393s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.580s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1478600297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825ea79e-655f-4e46-bcc9-0b77fd324652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae639520c49b3938224c08e331c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:08Z,use_quota=True,user_id='2c9c6411e38f4711839c493755e30b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Creating volume 825ea79e-655f-4e46-bcc9-0b77fd324652 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:13 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-825ea79e-655f-4e46-bcc9-0b77fd324652 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:13 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-825ea79e-655f-4e46-bcc9-0b77fd324652 1073741824 Feb 27 02:12:13 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a7a6d0-4ebe-4f91-a753-4fb831344193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cb9efe5-e7b2-4a03-b4a1-2575af62f687', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e38068f-0d53-4bd9-9532-f56e95aab3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:13 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Volume volume-3cb9efe5-e7b2-4a03-b4a1-2575af62f687 (3cb9efe5-e7b2-4a03-b4a1-2575af62f687): created successfully Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e38068f-0d53-4bd9-9532-f56e95aab3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:13 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Flow 'volume_create_manager' (d0500065-e78d-4e83-9ea5-d4ff9702b897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:13 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-073aedf5-9a59-4c49-912e-4016e8156b7b tempest-CreateVolumesFromSnapshotTest-378714314 None] Created volume successfully. Feb 27 02:12:14 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2" returned: 0 in 0.497s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:14 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-825ea79e-655f-4e46-bcc9-0b77fd324652 1073741824" returned: 0 in 0.455s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:14 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2 Feb 27 02:12:14 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-825ea79e-655f-4e46-bcc9-0b77fd324652 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:14 devstack sudo[91113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-825ea79e-655f-4e46-bcc9-0b77fd324652 Feb 27 02:12:14 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:14 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17.6797d4ca-1b4b-4f76-a269-9a3d229850c2" returned: 0 in 0.409s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] Lock "cinder-quobyte-6797d4ca-1b4b-4f76-a269-9a3d229850c2" released by "_delete_snapshot" :: held 1.913s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] Lock "cinder-quobyte-333329b1-1bdd-4e1a-9181-05585a3aad17" released by "delete_snapshot" :: held 1.932s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:14 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-825ea79e-655f-4e46-bcc9-0b77fd324652" returned: 0 in 0.410s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.208s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1411713874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6be6dd1-fe14-41cf-9f0d-0be4b0709212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae639520c49b3938224c08e331c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:08Z,use_quota=True,user_id='2c9c6411e38f4711839c493755e30b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Creating volume e6be6dd1-fe14-41cf-9f0d-0be4b0709212 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:14 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e6be6dd1-fe14-41cf-9f0d-0be4b0709212 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:14 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e6be6dd1-fe14-41cf-9f0d-0be4b0709212 1073741824 Feb 27 02:12:14 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0bfe46-758f-43be-b226-2663242429ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-825ea79e-655f-4e46-bcc9-0b77fd324652', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6dd4c24-6dba-4ed9-87ad-12b78990830e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:14 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Volume volume-825ea79e-655f-4e46-bcc9-0b77fd324652 (825ea79e-655f-4e46-bcc9-0b77fd324652): created successfully Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6dd4c24-6dba-4ed9-87ad-12b78990830e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Flow 'volume_create_manager' (740dc3d2-577c-48cb-84ed-8b35ffc4d221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:14 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-b62e57af-9280-48c9-aa61-f0ef5dbf2005 tempest-CreateVolumesFromSnapshotTest-378714314 None] Created volume successfully. Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] Created reservations ['3508e557-2e31-4cc6-a47b-fa27e00d6382', 'a028bdf0-d142-4f63-864c-c5b9d5d4917a', 'ac5323a9-805c-47cc-85e3-6769ba7af15b', '2c74db6a-e24e-4cbc-96be-04fb43cdf92e'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:14 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] Delete snapshot completed successfully. Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-3d52b2ea-133b-4afc-9816-e56c4512dfa3 tempest-SnapshotDependencyTests-1072117580 None] Lock "cinder-6797d4ca-1b4b-4f76-a269-9a3d229850c2-delete_snapshot" released by "delete_snapshot" :: held 2.078s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] Acquiring lock "cinder-333329b1-1bdd-4e1a-9181-05585a3aad17-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] Lock "cinder-333329b1-1bdd-4e1a-9181-05585a3aad17-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] Acquiring lock "cinder-quobyte-333329b1-1bdd-4e1a-9181-05585a3aad17" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] Lock "cinder-quobyte-333329b1-1bdd-4e1a-9181-05585a3aad17" acquired by "delete_volume" :: waited 0.019s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0a7379-aea9-4d94-8f20-913814b6758d]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:14 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:14 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 Feb 27 02:12:14 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:14 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e6be6dd1-fe14-41cf-9f0d-0be4b0709212 1073741824" returned: 0 in 0.489s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e6be6dd1-fe14-41cf-9f0d-0be4b0709212 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:15 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e6be6dd1-fe14-41cf-9f0d-0be4b0709212 Feb 27 02:12:15 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:15 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17" returned: 0 in 0.512s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:15 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17 Feb 27 02:12:15 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:15 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e6be6dd1-fe14-41cf-9f0d-0be4b0709212" returned: 0 in 0.380s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.892s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1886022453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d58360-374f-45f8-af0f-8c2f05cb3d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae639520c49b3938224c08e331c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:08Z,use_quota=True,user_id='2c9c6411e38f4711839c493755e30b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Creating volume 48d58360-374f-45f8-af0f-8c2f05cb3d49 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:15 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-48d58360-374f-45f8-af0f-8c2f05cb3d49 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1f69bf-744f-46c5-821d-fe4cae9ec9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6be6dd1-fe14-41cf-9f0d-0be4b0709212', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:15 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-48d58360-374f-45f8-af0f-8c2f05cb3d49 1073741824 Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31126d70-53ce-4a5c-9c1e-5503c564b1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:15 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:15 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Volume volume-e6be6dd1-fe14-41cf-9f0d-0be4b0709212 (e6be6dd1-fe14-41cf-9f0d-0be4b0709212): created successfully Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31126d70-53ce-4a5c-9c1e-5503c564b1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Flow 'volume_create_manager' (390f08cc-7d3b-4946-b1a6-c584d9d600d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:15 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-e299b4fb-4780-4266-bdbe-8eb5a8c6d04e tempest-CreateVolumesFromSnapshotTest-378714314 None] Created volume successfully. Feb 27 02:12:15 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-333329b1-1bdd-4e1a-9181-05585a3aad17" returned: 0 in 0.410s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] Lock "cinder-quobyte-333329b1-1bdd-4e1a-9181-05585a3aad17" released by "delete_volume" :: held 0.946s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] Created reservations ['d254bc50-3c71-4866-bb20-79704efa606a', 'ac261c33-2af5-4c80-8172-9afe844fdab5', '7a26b4e4-e775-4d3b-87d1-7fdd08bf6d10', '57cda443-cb05-4aca-8fdc-ae494520613a'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:15 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:12:15 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] Acquiring lock "cinder-763a316d-40be-40fe-ac86-c58fb1c48081-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] Lock "cinder-763a316d-40be-40fe-ac86-c58fb1c48081-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] Acquiring lock "cinder-quobyte-763a316d-40be-40fe-ac86-c58fb1c48081" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] Lock "cinder-quobyte-763a316d-40be-40fe-ac86-c58fb1c48081" acquired by "delete_volume" :: waited 0.019s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1148ebf-bfc6-4866-b653-e2ed05a093a5]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-763a316d-40be-40fe-ac86-c58fb1c48081 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:15 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-48d58360-374f-45f8-af0f-8c2f05cb3d49 1073741824" returned: 0 in 0.511s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:15 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-763a316d-40be-40fe-ac86-c58fb1c48081 Feb 27 02:12:15 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:15 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-48d58360-374f-45f8-af0f-8c2f05cb3d49 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:15 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-48d58360-374f-45f8-af0f-8c2f05cb3d49 Feb 27 02:12:15 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:16 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.488s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:16 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] Deleted volume successfully. Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-afd492e2-f90d-4471-b8d6-339c5061ce6b tempest-SnapshotDependencyTests-1072117580 None] Lock "cinder-333329b1-1bdd-4e1a-9181-05585a3aad17-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:16 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-763a316d-40be-40fe-ac86-c58fb1c48081" returned: 0 in 0.505s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-763a316d-40be-40fe-ac86-c58fb1c48081 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:16 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-763a316d-40be-40fe-ac86-c58fb1c48081 Feb 27 02:12:16 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:16 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-48d58360-374f-45f8-af0f-8c2f05cb3d49" returned: 0 in 0.449s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.639s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:16 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Cloning volume f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 to volume 32704ee0-5a6e-49e8-a688-5b72290504a6 Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c288ccd-c6ff-4130-b1cb-620da358437b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d58360-374f-45f8-af0f-8c2f05cb3d49', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e704058-fcc3-4bd0-ac2c-f205648263e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:16 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Volume volume-48d58360-374f-45f8-af0f-8c2f05cb3d49 (48d58360-374f-45f8-af0f-8c2f05cb3d49): created successfully Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e704058-fcc3-4bd0-ac2c-f205648263e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Flow 'volume_create_manager' (993d98f6-780a-4040-92c6-f551e82e1936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:16 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-22b167df-955e-4c5c-8d07-99d6b79f33e9 tempest-CreateVolumesFromSnapshotTest-378714314 None] Created volume successfully. Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Creating offline snapshot 1ca7798f-e3b7-4cfc-8e7a-18bfabe32211 of volume f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1d0d30-c447-4839-98a4-29d58cc652bb]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:16 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 Feb 27 02:12:16 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:16 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-763a316d-40be-40fe-ac86-c58fb1c48081" returned: 0 in 0.435s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] Lock "cinder-quobyte-763a316d-40be-40fe-ac86-c58fb1c48081" released by "delete_volume" :: held 0.964s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] Created reservations ['a241415f-d7e7-4d00-8353-3220dd3258a8', 'ed053268-e659-4e21-8e8d-6aa08138f434', '383e3a59-20d8-4c58-84fb-2e14d4725a84', '61f8b8c1-c2da-4f22-a93d-0c78a6a4707e'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:16 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:12:16 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:16 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78" returned: 0 in 0.483s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:16 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:16 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211 1G Feb 27 02:12:16 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:17 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "cinder-48d58360-374f-45f8-af0f-8c2f05cb3d49-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:17 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-48d58360-374f-45f8-af0f-8c2f05cb3d49-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:17 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "cinder-quobyte-48d58360-374f-45f8-af0f-8c2f05cb3d49" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:17 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-quobyte-48d58360-374f-45f8-af0f-8c2f05cb3d49" acquired by "delete_volume" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:17 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdc0447-eba8-45f2-8025-407fbfa6eac9]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-48d58360-374f-45f8-af0f-8c2f05cb3d49 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:17 devstack sudo[91161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-48d58360-374f-45f8-af0f-8c2f05cb3d49 Feb 27 02:12:17 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:17 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.462s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:17 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:17 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] Deleted volume successfully. Feb 27 02:12:17 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-41bbf6b2-e28d-4a0b-9c1f-67d0c253aa87 tempest-SnapshotDependencyTests-1072117580 None] Lock "cinder-763a316d-40be-40fe-ac86-c58fb1c48081-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:17 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211 1G" returned: 0 in 0.541s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:17 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211 Feb 27 02:12:17 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:17 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-48d58360-374f-45f8-af0f-8c2f05cb3d49" returned: 0 in 0.516s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-48d58360-374f-45f8-af0f-8c2f05cb3d49 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:17 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-48d58360-374f-45f8-af0f-8c2f05cb3d49 Feb 27 02:12:17 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:17 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211" returned: 0 in 0.425s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:17 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211 is being set with open permissions: ugo+rw Feb 27 02:12:17 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:17 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211 Feb 27 02:12:17 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:18 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-48d58360-374f-45f8-af0f-8c2f05cb3d49" returned: 0 in 0.420s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-quobyte-48d58360-374f-45f8-af0f-8c2f05cb3d49" released by "delete_volume" :: held 0.972s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] Created reservations ['40c8c8f2-142b-4fc9-ac92-8f3541ab7134', 'f6dedb07-690c-4ba3-b89e-3616dc2be808', '7d6c83be-0bf4-4e90-b899-df122011d5af', '5f238305-c757-4b97-90fc-662386c8e394'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "cinder-e6be6dd1-fe14-41cf-9f0d-0be4b0709212-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:18 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:12:18 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-e6be6dd1-fe14-41cf-9f0d-0be4b0709212-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "cinder-quobyte-e6be6dd1-fe14-41cf-9f0d-0be4b0709212" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-quobyte-e6be6dd1-fe14-41cf-9f0d-0be4b0709212" acquired by "delete_volume" :: waited 0.018s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cd4c23-f428-488d-ad39-59b46298760f]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e6be6dd1-fe14-41cf-9f0d-0be4b0709212 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:18 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211" returned: 0 in 0.482s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:18 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.info Feb 27 02:12:18 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:18 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e6be6dd1-fe14-41cf-9f0d-0be4b0709212 Feb 27 02:12:18 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:18 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.515s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:18 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] Deleted volume successfully. Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-c9db79b4-dd17-4c52-afb0-ad2096ecdbff tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-48d58360-374f-45f8-af0f-8c2f05cb3d49-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:18 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:18 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e6be6dd1-fe14-41cf-9f0d-0be4b0709212" returned: 0 in 0.570s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e6be6dd1-fe14-41cf-9f0d-0be4b0709212 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.info" returned: 0 in 0.525s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:18 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.info is being set with open permissions: ugo+rw Feb 27 02:12:18 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:18 devstack sudo[91192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e6be6dd1-fe14-41cf-9f0d-0be4b0709212 Feb 27 02:12:18 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:18 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.info Feb 27 02:12:18 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:19 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.info" returned: 0 in 0.441s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "cinder-quobyte-32704ee0-5a6e-49e8-a688-5b72290504a6" by "_copy_volume_from_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-32704ee0-5a6e-49e8-a688-5b72290504a6" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] snapshot: 1ca7798f-e3b7-4cfc-8e7a-18bfabe32211, volume: 32704ee0-5a6e-49e8-a688-5b72290504a6, {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:19 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-e6be6dd1-fe14-41cf-9f0d-0be4b0709212" returned: 0 in 0.501s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-quobyte-e6be6dd1-fe14-41cf-9f0d-0be4b0709212" released by "delete_volume" :: held 1.107s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a74089-0882-42b0-aeef-9afed88edae5]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] Created reservations ['cfe5cdb4-b901-4cff-a105-8c6d0c8bd986', '3746cbce-0039-4bd9-9ab1-d12d524d81f6', '982e6024-3f57-4d78-a6e4-cce1bbce0bb1', 'a509d5cb-5bae-4dba-860d-310d177a93b7'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:19 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211 Feb 27 02:12:19 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:19 devstack sudo[91201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:12:19 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:19 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.412s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:19 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] Deleted volume successfully. Feb 27 02:12:19 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-787342f9-145c-433b-9c53-78ec218a9aca tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-e6be6dd1-fe14-41cf-9f0d-0be4b0709212-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:20 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211" returned: 0 in 0.555s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:20 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:20 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] will copy from snapshot at /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:12:20 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Creating direct copy from snapshot {{(pid=83231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:12:20 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[550dbca8-562d-40d8-b3f6-791b2c9ac00f]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:20 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 Feb 27 02:12:20 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:20 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "cinder-825ea79e-655f-4e46-bcc9-0b77fd324652-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:20 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-825ea79e-655f-4e46-bcc9-0b77fd324652-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:20 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "cinder-quobyte-825ea79e-655f-4e46-bcc9-0b77fd324652" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:20 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-quobyte-825ea79e-655f-4e46-bcc9-0b77fd324652" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:20 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78" returned: 0 in 0.543s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:20 devstack cinder-volume[83231]: DEBUG cinder.utils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Path /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-32704ee0-5a6e-49e8-a688-5b72290504a6 not found in is_blk_device check {{(pid=83231) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:12:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-32704ee0-5a6e-49e8-a688-5b72290504a6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:20 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60a690b-227e-4c0a-94a4-55b8446d0248]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:20 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-825ea79e-655f-4e46-bcc9-0b77fd324652 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:20 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-32704ee0-5a6e-49e8-a688-5b72290504a6 Feb 27 02:12:20 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:20 devstack sudo[91213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-825ea79e-655f-4e46-bcc9-0b77fd324652 Feb 27 02:12:20 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:21 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-825ea79e-655f-4e46-bcc9-0b77fd324652" returned: 0 in 0.882s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:21 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-825ea79e-655f-4e46-bcc9-0b77fd324652 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:21 devstack sudo[91242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-825ea79e-655f-4e46-bcc9-0b77fd324652 Feb 27 02:12:21 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:22 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-825ea79e-655f-4e46-bcc9-0b77fd324652" returned: 0 in 1.292s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:22 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-quobyte-825ea79e-655f-4e46-bcc9-0b77fd324652" released by "delete_volume" :: held 2.226s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:22 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] Created reservations ['1c4eeee1-527f-4203-a002-ac3c20227211', '30a9561e-f693-4c7e-9f4e-9d5e2bf4f3c4', '4c3ece99-1d36-4bb9-b247-59163d6e15a1', '5eedc5da-815a-4ff5-bbe2-e936e28a729f'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:22 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:22 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:22 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:12:22 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:22 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-32704ee0-5a6e-49e8-a688-5b72290504a6" returned: 0 in 2.347s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:22 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac1d7f0-cce3-4598-8827-697baada5b02]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:22 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:22 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 Feb 27 02:12:22 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:23 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.460s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:23 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:23 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] Deleted volume successfully. Feb 27 02:12:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-dbba5472-d32d-4e83-a536-4d5701547ac4 tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-825ea79e-655f-4e46-bcc9-0b77fd324652-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:23 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78" returned: 0 in 0.639s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:23 devstack cinder-volume[83231]: DEBUG cinder.image.image_utils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Image conversion details: src /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78, size 1024.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-32704ee0-5a6e-49e8-a688-5b72290504a6 {{(pid=83231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:12:23 devstack cinder-volume[83231]: INFO cinder.image.image_utils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Converted 1024.00 MB image at 436.02 MB/s Feb 27 02:12:23 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-32704ee0-5a6e-49e8-a688-5b72290504a6 is being set with open permissions: ugo+rw Feb 27 02:12:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-32704ee0-5a6e-49e8-a688-5b72290504a6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:23 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-32704ee0-5a6e-49e8-a688-5b72290504a6 Feb 27 02:12:23 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "cinder-3cb9efe5-e7b2-4a03-b4a1-2575af62f687-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-3cb9efe5-e7b2-4a03-b4a1-2575af62f687-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "cinder-quobyte-3cb9efe5-e7b2-4a03-b4a1-2575af62f687" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:23 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-quobyte-3cb9efe5-e7b2-4a03-b4a1-2575af62f687" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:23 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3f6df8-a683-4915-8934-1afaf8872dce]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:23 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3cb9efe5-e7b2-4a03-b4a1-2575af62f687 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:24 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3cb9efe5-e7b2-4a03-b4a1-2575af62f687 Feb 27 02:12:24 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:24 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-32704ee0-5a6e-49e8-a688-5b72290504a6" returned: 0 in 0.485s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:24 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-32704ee0-5a6e-49e8-a688-5b72290504a6" released by "_copy_volume_from_snapshot" :: held 4.638s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:24 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "cinder-quobyte-1ca7798f-e3b7-4cfc-8e7a-18bfabe32211" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:24 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-1ca7798f-e3b7-4cfc-8e7a-18bfabe32211" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:24 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Deleting offline snapshot 1ca7798f-e3b7-4cfc-8e7a-18bfabe32211 of volume f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:12:24 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] snapshot_file for this snap is: volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:12:24 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e19808-ae1b-4c0e-a907-c16c3aa1cbe7]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:24 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211 Feb 27 02:12:24 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:24 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3cb9efe5-e7b2-4a03-b4a1-2575af62f687" returned: 0 in 0.570s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3cb9efe5-e7b2-4a03-b4a1-2575af62f687 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:24 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3cb9efe5-e7b2-4a03-b4a1-2575af62f687 Feb 27 02:12:24 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:24 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211" returned: 0 in 0.528s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:24 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:24 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[623a4010-34ec-432d-ab5a-ba15de356de8]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:24 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:24 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 Feb 27 02:12:24 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:25 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-3cb9efe5-e7b2-4a03-b4a1-2575af62f687" returned: 0 in 0.533s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:25 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-quobyte-3cb9efe5-e7b2-4a03-b4a1-2575af62f687" released by "delete_volume" :: held 1.125s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:25 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] Created reservations ['e61e3781-7269-4fcc-ab8f-4692fd23c59c', 'a4b2fd3d-e96d-4de2-ae14-9b1ac9f363f0', 'cccabf05-6db3-4348-89e0-62024d905fd9', 'b065c44c-4659-4344-9064-b6bd1bbc79a8'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:25 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:25 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:25 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:12:25 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:25 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78" returned: 0 in 0.590s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:25 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211 Feb 27 02:12:25 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:25 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.464s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:25 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:25 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] Deleted volume successfully. Feb 27 02:12:25 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-790aa1a3-fa32-432f-b994-8e58ae1c4d8a tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-3cb9efe5-e7b2-4a03-b4a1-2575af62f687-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:25 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211" returned: 0 in 0.543s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:25 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:25 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211 Feb 27 02:12:25 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "cinder-efd186b3-8180-45d2-a11e-7bbe841de04a-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-efd186b3-8180-45d2-a11e-7bbe841de04a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "cinder-quobyte-efd186b3-8180-45d2-a11e-7bbe841de04a" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-quobyte-efd186b3-8180-45d2-a11e-7bbe841de04a" acquired by "delete_volume" :: waited 0.019s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4525a55-ed73-4cef-bfc4-96f783c27702]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-efd186b3-8180-45d2-a11e-7bbe841de04a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:26 devstack sudo[91309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-efd186b3-8180-45d2-a11e-7bbe841de04a Feb 27 02:12:26 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:26 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78.1ca7798f-e3b7-4cfc-8e7a-18bfabe32211" returned: 0 in 0.480s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-1ca7798f-e3b7-4cfc-8e7a-18bfabe32211" released by "_delete_snapshot" :: held 2.189s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.877s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.424s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4d482e-043c-4907-b600-98acd7a3bb22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e18d8dd4974313bd809261c7efb279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:09Z,use_quota=True,user_id='52655a2672c34e1eabc252116185edbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Creating volume 7f4d482e-043c-4907-b600-98acd7a3bb22 {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:26 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7f4d482e-043c-4907-b600-98acd7a3bb22 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d76848-27bc-4a40-bab6-7533335cf584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32704ee0-5a6e-49e8-a688-5b72290504a6', 'volume_size': 1, 'source_volid': 'f79a45d7-f7cf-40df-8677-ffa2c7cc5c78', 'source_volstatus': 'available'}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:26 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7f4d482e-043c-4907-b600-98acd7a3bb22 1073741824 Feb 27 02:12:26 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9a9b9b-335a-4954-b08c-237bcc22e93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:26 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Volume volume-32704ee0-5a6e-49e8-a688-5b72290504a6 (32704ee0-5a6e-49e8-a688-5b72290504a6): created successfully Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9a9b9b-335a-4954-b08c-237bcc22e93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Flow 'volume_create_manager' (495db50c-5d7f-48d4-95cb-523dc0046f77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:26 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-26243f70-3213-4cdc-a746-3978191e67c8 tempest-VolumeDependencyTests-122603111 None] Created volume successfully. Feb 27 02:12:26 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-efd186b3-8180-45d2-a11e-7bbe841de04a" returned: 0 in 0.490s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-efd186b3-8180-45d2-a11e-7bbe841de04a {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:26 devstack sudo[91319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-efd186b3-8180-45d2-a11e-7bbe841de04a Feb 27 02:12:26 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:26 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7f4d482e-043c-4907-b600-98acd7a3bb22 1073741824" returned: 0 in 0.489s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7f4d482e-043c-4907-b600-98acd7a3bb22 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:26 devstack sudo[91322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7f4d482e-043c-4907-b600-98acd7a3bb22 Feb 27 02:12:26 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "cinder-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "cinder-quobyte-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78" acquired by "delete_volume" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[959d76ce-1788-41bb-be88-4f618022a36c]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:26 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:27 devstack sudo[91324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 Feb 27 02:12:27 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:27 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-efd186b3-8180-45d2-a11e-7bbe841de04a" returned: 0 in 0.447s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-quobyte-efd186b3-8180-45d2-a11e-7bbe841de04a" released by "delete_volume" :: held 0.973s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] Created reservations ['d8c2bf0a-c40c-4d5b-bad2-0e1eebb8be48', 'a65f2393-6fc9-4066-8862-8e83e8eccc47', '428114c3-accf-46ad-bc52-888ac9849e1b', 'e62661a9-9734-4f7d-b267-addb8e923780'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:27 devstack sudo[91327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:12:27 devstack sudo[91327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:27 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7f4d482e-043c-4907-b600-98acd7a3bb22" returned: 0 in 0.460s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a247ffec-1627-4b2e-b5ef-07d5f1c5dc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f4d482e-043c-4907-b600-98acd7a3bb22', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcc916e-179d-4e56-9351-f3ca5e9c525d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:27 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Volume volume-7f4d482e-043c-4907-b600-98acd7a3bb22 (7f4d482e-043c-4907-b600-98acd7a3bb22): created successfully Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcc916e-179d-4e56-9351-f3ca5e9c525d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Flow 'volume_create_manager' (7d46cd1c-144d-44f2-9eba-25210a1cc66c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:27 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-15d854d4-05eb-4da1-b1bf-e8e1e3dbe14b tempest-CinderUnicodeTest-757738199 None] Created volume successfully. Feb 27 02:12:27 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78" returned: 0 in 0.511s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:27 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78 Feb 27 02:12:27 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:27 devstack sudo[91327]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.487s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:27 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] Deleted volume successfully. Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-07afbdd1-4938-4543-9130-1536e99fa34e tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-efd186b3-8180-45d2-a11e-7bbe841de04a-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:27 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78" returned: 0 in 0.430s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78" released by "delete_volume" :: held 0.984s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] Created reservations ['5c3dd129-51e6-4c2f-ac4d-5c42abb4bfef', '41311d68-28ef-4567-8976-a65e47800a7f', '1f74a0b0-f0dd-451f-8b17-85aef30b008e', 'a46cdd53-7d74-4203-820c-14ee424bb58a'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:27 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:28 devstack sudo[91337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:12:28 devstack sudo[91337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "cinder-72140d14-1488-4704-9d86-e4a940de5a0f-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-72140d14-1488-4704-9d86-e4a940de5a0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "cinder-quobyte-88500fae-4b03-49bd-af78-241d69084c9f" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.volume.flows.manager.create_volume [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Flow 'volume_create_manager' (07cd7914-5167-4010-9ab1-7d2a608e5f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02cb2162-c1ec-4d7d-b1b2-346123f680a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-quobyte-88500fae-4b03-49bd-af78-241d69084c9f" acquired by "delete_snapshot" :: waited 0.048s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "cinder-quobyte-72140d14-1488-4704-9d86-e4a940de5a0f" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02cb2162-c1ec-4d7d-b1b2-346123f680a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-306720563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505db96c-27f0-4d48-a669-2446cbbf3a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e18d8dd4974313bd809261c7efb279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:28Z,use_quota=True,user_id='52655a2672c34e1eabc252116185edbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a845202-0be2-4820-8246-c8ee04567f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a845202-0be2-4820-8246-c8ee04567f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a8ff91-22df-4854-8880-e8a191af8cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a8ff91-22df-4854-8880-e8a191af8cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '505db96c-27f0-4d48-a669-2446cbbf3a2c', 'volume_name': 'volume-505db96c-27f0-4d48-a669-2446cbbf3a2c', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdef348c-7d1d-47a0-9f97-89ad44ea20b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdef348c-7d1d-47a0-9f97-89ad44ea20b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb6a2cca-afd5-4fee-a4be-a7fdbf70a513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:28 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Volume 505db96c-27f0-4d48-a669-2446cbbf3a2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-505db96c-27f0-4d48-a669-2446cbbf3a2c', 'volume_size': 1} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-306720563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505db96c-27f0-4d48-a669-2446cbbf3a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e18d8dd4974313bd809261c7efb279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:28Z,use_quota=True,user_id='52655a2672c34e1eabc252116185edbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6f6824-3950-4b8c-9358-28aa08021c2e),volume_type_id=df6f6824-3950-4b8c-9358-28aa08021c2e)}" {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Creating volume 505db96c-27f0-4d48-a669-2446cbbf3a2c {{(pid=83231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Selected osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa as target Quobyte volume. {{(pid=83231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:28 devstack cinder-volume[83231]: INFO cinder.volume.drivers.remotefs [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] casted to osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c 1073741824 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-quobyte-72140d14-1488-4704-9d86-e4a940de5a0f" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] Deleting offline snapshot 72140d14-1488-4704-9d86-e4a940de5a0f of volume 88500fae-4b03-49bd-af78-241d69084c9f {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:12:28 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c 1073741824 Feb 27 02:12:28 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] snapshot_file for this snap is: volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a21dae2-a271-4622-bd41-ad2e269887d1]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:28 devstack sudo[91337]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.462s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:28 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] Deleted volume successfully. Feb 27 02:12:28 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f Feb 27 02:12:28 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-12e4f159-d4b0-4a83-af69-3d29b3dcd0e4 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-f79a45d7-f7cf-40df-8677-ffa2c7cc5c78-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:28 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f" returned: 0 in 0.487s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:28 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88500fae-4b03-49bd-af78-241d69084c9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c 1073741824" returned: 0 in 0.527s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2a9077-ae80-4772-a5d9-7579ff4d7a8a]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:28 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:28 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c Feb 27 02:12:28 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:28 devstack sudo[91350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f Feb 27 02:12:28 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "cinder-32704ee0-5a6e-49e8-a688-5b72290504a6-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-32704ee0-5a6e-49e8-a688-5b72290504a6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "cinder-quobyte-32704ee0-5a6e-49e8-a688-5b72290504a6" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:29 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-32704ee0-5a6e-49e8-a688-5b72290504a6" acquired by "delete_volume" :: waited 0.007s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:29 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[215780de-618b-4fde-b776-0065603006b1]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-32704ee0-5a6e-49e8-a688-5b72290504a6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:29 devstack sudo[91354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-32704ee0-5a6e-49e8-a688-5b72290504a6 Feb 27 02:12:29 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:29 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c" returned: 0 in 0.534s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:29 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'} {{(pid=83231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb6a2cca-afd5-4fee-a4be-a7fdbf70a513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-505db96c-27f0-4d48-a669-2446cbbf3a2c', 'volume_size': 1}' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c030825d-11be-44ef-a3f8-44c4aafef8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:29 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f" returned: 0 in 0.577s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:29 devstack cinder-volume[83231]: INFO cinder.volume.flows.manager.create_volume [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Volume volume-505db96c-27f0-4d48-a669-2446cbbf3a2c (505db96c-27f0-4d48-a669-2446cbbf3a2c): created successfully Feb 27 02:12:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c030825d-11be-44ef-a3f8-44c4aafef8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83231) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:29 devstack cinder-volume[83231]: DEBUG cinder.volume.manager [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Flow 'volume_create_manager' (07cd7914-5167-4010-9ab1-7d2a608e5f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83231) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:29 devstack sudo[91360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f Feb 27 02:12:29 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:29 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-18abc52a-482e-4060-bb11-38ac0f76e237 tempest-CinderUnicodeTest-757738199 None] Created volume successfully. Feb 27 02:12:29 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-32704ee0-5a6e-49e8-a688-5b72290504a6" returned: 0 in 0.594s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-32704ee0-5a6e-49e8-a688-5b72290504a6 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:29 devstack sudo[91365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-32704ee0-5a6e-49e8-a688-5b72290504a6 Feb 27 02:12:29 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:29 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f" returned: 0 in 0.470s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:29 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:29 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f Feb 27 02:12:29 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:30 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-32704ee0-5a6e-49e8-a688-5b72290504a6" returned: 0 in 0.482s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-32704ee0-5a6e-49e8-a688-5b72290504a6" released by "delete_volume" :: held 1.096s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] Created reservations ['fac7fddc-63a6-4c29-a3ee-10469a23a706', '34c5b645-6fb3-4590-b84b-0c1830381945', '3f186df3-9758-4f06-ac09-365497325b70', '4429040e-a59d-4c6f-85ce-3cfdaa586d50'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:30 devstack sudo[91374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:12:30 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:30 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f.72140d14-1488-4704-9d86-e4a940de5a0f" returned: 0 in 0.462s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-quobyte-72140d14-1488-4704-9d86-e4a940de5a0f" released by "_delete_snapshot" :: held 2.063s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-quobyte-88500fae-4b03-49bd-af78-241d69084c9f" released by "delete_snapshot" :: held 2.126s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] Created reservations ['d68a6f83-6c75-491d-9543-2d2de51a09ca', '0f2a3311-eef4-4709-8115-66a6da040424', '301a0bdd-053e-4a35-93a7-b2ec12a810aa', 'f03c5d60-51f4-4aa0-8881-bac54fc32907'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:30 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] Delete snapshot completed successfully. Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-ab180418-552e-433e-90ee-ae62afe8568b tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-72140d14-1488-4704-9d86-e4a940de5a0f-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-3cd3ec02-753d-4c45-8ee6-8059f8b79812 tempest-CinderUnicodeTest-757738199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-3cd3ec02-753d-4c45-8ee6-8059f8b79812 tempest-CinderUnicodeTest-757738199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-3cd3ec02-753d-4c45-8ee6-8059f8b79812 tempest-CinderUnicodeTest-757738199 None] Creating offline snapshot beb08f19-b3ed-420e-9613-08049a5cdc96 of volume 505db96c-27f0-4d48-a669-2446cbbf3a2c {{(pid=83231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[57963336-aab1-44d9-aeae-b7813118b58b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3cd3ec02-753d-4c45-8ee6-8059f8b79812 tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:30 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c Feb 27 02:12:30 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:30 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.499s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:30 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] Deleted volume successfully. Feb 27 02:12:30 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6629b255-03a7-4b45-a9ed-3213acbc8ce3 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-32704ee0-5a6e-49e8-a688-5b72290504a6-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:31 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3cd3ec02-753d-4c45-8ee6-8059f8b79812 tempest-CinderUnicodeTest-757738199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c" returned: 0 in 0.487s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3cd3ec02-753d-4c45-8ee6-8059f8b79812 tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96 1G {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:31 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96 1G Feb 27 02:12:31 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "cinder-5050af03-63bf-4485-8292-fa23b76a3fb9-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-5050af03-63bf-4485-8292-fa23b76a3fb9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "cinder-quobyte-5050af03-63bf-4485-8292-fa23b76a3fb9" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-5050af03-63bf-4485-8292-fa23b76a3fb9" acquired by "delete_volume" :: waited 0.007s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:31 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7febabf1-e96f-4978-90ed-12a62ef32dd9]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5050af03-63bf-4485-8292-fa23b76a3fb9 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "cinder-88500fae-4b03-49bd-af78-241d69084c9f-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-88500fae-4b03-49bd-af78-241d69084c9f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "cinder-quobyte-88500fae-4b03-49bd-af78-241d69084c9f" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:31 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5050af03-63bf-4485-8292-fa23b76a3fb9 Feb 27 02:12:31 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:31 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-quobyte-88500fae-4b03-49bd-af78-241d69084c9f" acquired by "delete_volume" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:31 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5fd6d1-a767-4d40-ae16-4565fae766cb]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:31 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f Feb 27 02:12:31 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:31 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3cd3ec02-753d-4c45-8ee6-8059f8b79812 tempest-CinderUnicodeTest-757738199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96 1G" returned: 0 in 0.581s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3cd3ec02-753d-4c45-8ee6-8059f8b79812 tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-505db96c-27f0-4d48-a669-2446cbbf3a2c -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:31 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-505db96c-27f0-4d48-a669-2446cbbf3a2c -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96 Feb 27 02:12:31 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:31 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5050af03-63bf-4485-8292-fa23b76a3fb9" returned: 0 in 0.513s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:31 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5050af03-63bf-4485-8292-fa23b76a3fb9 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:31 devstack sudo[91396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5050af03-63bf-4485-8292-fa23b76a3fb9 Feb 27 02:12:31 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:32 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f" returned: 0 in 0.505s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:32 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f Feb 27 02:12:32 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:32 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3cd3ec02-753d-4c45-8ee6-8059f8b79812 tempest-CinderUnicodeTest-757738199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-505db96c-27f0-4d48-a669-2446cbbf3a2c -F qcow2 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96" returned: 0 in 0.492s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:32 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-3cd3ec02-753d-4c45-8ee6-8059f8b79812 tempest-CinderUnicodeTest-757738199 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96 is being set with open permissions: ugo+rw Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3cd3ec02-753d-4c45-8ee6-8059f8b79812 tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:32 devstack sudo[91407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96 Feb 27 02:12:32 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:32 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-5050af03-63bf-4485-8292-fa23b76a3fb9" returned: 0 in 0.397s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-quobyte-5050af03-63bf-4485-8292-fa23b76a3fb9" released by "delete_volume" :: held 0.945s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] Created reservations ['f7b25ad3-3aa2-4843-a676-f96da96e7ba4', 'd708ab90-b59e-4c1e-af2c-72358a602f89', '9565c4a7-fe7e-4194-a17d-44bce250166d', '9b17fa7c-6f71-4e8e-8706-45bbfc97c4e8'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:32 devstack sudo[91410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:12:32 devstack sudo[91410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:32 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-88500fae-4b03-49bd-af78-241d69084c9f" returned: 0 in 0.437s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-quobyte-88500fae-4b03-49bd-af78-241d69084c9f" released by "delete_volume" :: held 0.982s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] Created reservations ['2095f74a-6eb9-4be5-bf50-8ce0d4322592', '15bc26fb-d646-4933-84d8-02b1b75eaeb9', 'e73c225c-3cb5-4d70-b91e-ec68c2ffea04', '8fab0da6-7346-43c8-bc7c-2fbb32afa1ad'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:32 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:12:32 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:32 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3cd3ec02-753d-4c45-8ee6-8059f8b79812 tempest-CinderUnicodeTest-757738199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96" returned: 0 in 0.607s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3cd3ec02-753d-4c45-8ee6-8059f8b79812 tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:32 devstack sudo[91417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.info Feb 27 02:12:32 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:32 devstack sudo[91410]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.571s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:32 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] Deleted volume successfully. Feb 27 02:12:32 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-1549936a-887e-4e29-8b2c-00c0407aa7e2 tempest-VolumeDependencyTests-122603111 None] Lock "cinder-5050af03-63bf-4485-8292-fa23b76a3fb9-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:33 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.554s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:33 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:33 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] Deleted volume successfully. Feb 27 02:12:33 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-25c4d62e-a814-48bd-ab8b-034e77ee23cb tempest-CreateVolumesFromSnapshotTest-378714314 None] Lock "cinder-88500fae-4b03-49bd-af78-241d69084c9f-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:33 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3cd3ec02-753d-4c45-8ee6-8059f8b79812 tempest-CinderUnicodeTest-757738199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.info" returned: 0 in 0.554s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:33 devstack cinder-volume[83231]: WARNING cinder.volume.drivers.remotefs [None req-3cd3ec02-753d-4c45-8ee6-8059f8b79812 tempest-CinderUnicodeTest-757738199 None] /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.info is being set with open permissions: ugo+rw Feb 27 02:12:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3cd3ec02-753d-4c45-8ee6-8059f8b79812 tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.info {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:33 devstack sudo[91422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.info Feb 27 02:12:33 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:33 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-3cd3ec02-753d-4c45-8ee6-8059f8b79812 tempest-CinderUnicodeTest-757738199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.info" returned: 0 in 0.456s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:33 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-3cd3ec02-753d-4c45-8ee6-8059f8b79812 tempest-CinderUnicodeTest-757738199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.249s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:33 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-3cd3ec02-753d-4c45-8ee6-8059f8b79812 tempest-CinderUnicodeTest-757738199 None] Create snapshot completed successfully Feb 27 02:12:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] Acquiring lock "cinder-beb08f19-b3ed-420e-9613-08049a5cdc96-delete_snapshot" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] Lock "cinder-beb08f19-b3ed-420e-9613-08049a5cdc96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] Acquiring lock "cinder-quobyte-505db96c-27f0-4d48-a669-2446cbbf3a2c" by "delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] Lock "cinder-quobyte-505db96c-27f0-4d48-a669-2446cbbf3a2c" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] Acquiring lock "cinder-quobyte-beb08f19-b3ed-420e-9613-08049a5cdc96" by "_delete_snapshot" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:34 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] Lock "cinder-quobyte-beb08f19-b3ed-420e-9613-08049a5cdc96" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:34 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] Deleting offline snapshot beb08f19-b3ed-420e-9613-08049a5cdc96 of volume 505db96c-27f0-4d48-a669-2446cbbf3a2c {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:12:34 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] snapshot_file for this snap is: volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96 {{(pid=83231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:12:34 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0857df-3c3f-47fe-af71-4afa5ba5af9b]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:34 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:34 devstack sudo[91425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96 Feb 27 02:12:34 devstack sudo[91425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:35 devstack sudo[91425]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96" returned: 0 in 0.476s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:35 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.remotefs [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-505db96c-27f0-4d48-a669-2446cbbf3a2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:35 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38c2dba-8889-4703-a9bc-fdf09fab1e67]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:35 devstack sudo[91430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c Feb 27 02:12:35 devstack sudo[91430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:35 devstack sudo[91430]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c" returned: 0 in 0.453s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:35 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:35 devstack sudo[91435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96 Feb 27 02:12:35 devstack sudo[91435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:36 devstack sudo[91435]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96" returned: 0 in 0.423s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:36 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96 Feb 27 02:12:36 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:36 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c.beb08f19-b3ed-420e-9613-08049a5cdc96" returned: 0 in 0.372s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:36 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] Lock "cinder-quobyte-beb08f19-b3ed-420e-9613-08049a5cdc96" released by "_delete_snapshot" :: held 1.777s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:36 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] Lock "cinder-quobyte-505db96c-27f0-4d48-a669-2446cbbf3a2c" released by "delete_snapshot" :: held 1.787s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:36 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] Created reservations ['e0ff1e03-81b9-4e8f-ac3c-46502f7fc731', '7cdcfcd0-d605-40de-a1fa-08c21a820541', '2e131f3d-fb78-46de-b469-8520f4a97651', '9b93d66f-f42f-4da2-92b4-2702491bf5cb'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:36 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] Delete snapshot completed successfully. Feb 27 02:12:36 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-19288324-8e1f-4cef-b467-7dec96933f23 tempest-CinderUnicodeTest-757738199 None] Lock "cinder-beb08f19-b3ed-420e-9613-08049a5cdc96-delete_snapshot" released by "delete_snapshot" :: held 1.879s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:36 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] Acquiring lock "cinder-505db96c-27f0-4d48-a669-2446cbbf3a2c-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:36 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] Lock "cinder-505db96c-27f0-4d48-a669-2446cbbf3a2c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:36 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] Acquiring lock "cinder-quobyte-505db96c-27f0-4d48-a669-2446cbbf3a2c" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:36 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] Lock "cinder-quobyte-505db96c-27f0-4d48-a669-2446cbbf3a2c" acquired by "delete_volume" :: waited 0.007s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:36 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[762fc6e2-1146-441f-b4dd-e3f42bbc0913]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:36 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:37 devstack sudo[91443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c Feb 27 02:12:37 devstack sudo[91443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:37 devstack sudo[91443]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c" returned: 0 in 0.444s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:37 devstack sudo[91448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c Feb 27 02:12:37 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:37 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-505db96c-27f0-4d48-a669-2446cbbf3a2c" returned: 0 in 0.387s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:37 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] Lock "cinder-quobyte-505db96c-27f0-4d48-a669-2446cbbf3a2c" released by "delete_volume" :: held 0.867s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:37 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] Created reservations ['7edd3747-7037-4280-a747-5bc203e13832', '11587f43-dea8-4123-a1f4-bcdf745c5ed1', '5d53b771-50c7-4441-8efc-940e589ee7aa', 'a8740193-dd5a-44af-ba89-550b74c6b793'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:37 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:37 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:37 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:12:37 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:38 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] Acquiring lock "cinder-7f4d482e-043c-4907-b600-98acd7a3bb22-delete_volume" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:38 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] Lock "cinder-7f4d482e-043c-4907-b600-98acd7a3bb22-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:38 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] Acquiring lock "cinder-quobyte-7f4d482e-043c-4907-b600-98acd7a3bb22" by "delete_volume" {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:38 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] Lock "cinder-quobyte-7f4d482e-043c-4907-b600-98acd7a3bb22" acquired by "delete_volume" :: waited 0.007s {{(pid=83231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:38 devstack cinder-volume[83231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23705d4-c053-4137-b090-87ef54b1405a]: (4, 'qcow2') {{(pid=83907) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7f4d482e-043c-4907-b600-98acd7a3bb22 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:38 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7f4d482e-043c-4907-b600-98acd7a3bb22 Feb 27 02:12:38 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:38 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.444s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:38 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:38 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] Deleted volume successfully. Feb 27 02:12:38 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-af7c7004-2c43-484c-91b7-3f2333d5f977 tempest-CinderUnicodeTest-757738199 None] Lock "cinder-505db96c-27f0-4d48-a669-2446cbbf3a2c-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:38 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7f4d482e-043c-4907-b600-98acd7a3bb22" returned: 0 in 0.459s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7f4d482e-043c-4907-b600-98acd7a3bb22 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:38 devstack sudo[91459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7f4d482e-043c-4907-b600-98acd7a3bb22 Feb 27 02:12:38 devstack sudo[91459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:38 devstack sudo[91459]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:38 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81/volume-7f4d482e-043c-4907-b600-98acd7a3bb22" returned: 0 in 0.379s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:38 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] Lock "cinder-quobyte-7f4d482e-043c-4907-b600-98acd7a3bb22" released by "delete_volume" :: held 0.869s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:38 devstack cinder-volume[83231]: DEBUG cinder.quota [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] Created reservations ['356d9a2a-dd4e-43a5-88ae-cb1c97af2a49', 'b1ef309b-a8fe-4ede-a619-46c675168919', '55c2928c-38e5-479d-bc7e-6aef744ea096', '2f9ecde8-0c91-42bf-a2d5-f3d82725c43e'] {{(pid=83231) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:39 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:39 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:12:39 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:39 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:39 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.421s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:39 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:39 devstack cinder-volume[83231]: INFO cinder.volume.manager [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] Deleted volume successfully. Feb 27 02:12:39 devstack cinder-volume[83231]: DEBUG cinder.coordination [None req-6a24af3b-e015-461e-b543-7afea5aa3f02 tempest-CinderUnicodeTest-757738199 None] Lock "cinder-7f4d482e-043c-4907-b600-98acd7a3bb22-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=83231) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:47 devstack cinder-volume[83231]: DEBUG oslo_service.periodic_task [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83231) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:12:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa': None} {{(pid=83231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:47 devstack cinder-volume[83231]: DEBUG cinder.volume.drivers.quobyte [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a23946dd-d6ec-4a02-87cd-524854606efa'] {{(pid=83231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.lockutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:47 devstack sudo[91501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81 Feb 27 02:12:47 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:47 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:47 devstack cinder-volume[83231]: DEBUG oslo_concurrency.processutils [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/50db673aceab234fb621d161df9dfe81" returned: 0 in 0.423s {{(pid=83231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:47 devstack cinder-volume[83231]: DEBUG cinder.manager [None req-5c00904a-710d-482d-b8e9-2fd7884ce37d None None] Notifying Schedulers of capabilities ... {{(pid=83231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:48 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=203,cinder:UPDATE=288,cinder:DELETE=21,cinder:INSERT=69 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:12:48 devstack cinder-volume[83231]: DEBUG dbcounter [-] [83231] Writing DB stats cinder:SELECT=187,cinder:INSERT=69,cinder:UPDATE=269,cinder:DELETE=26 {{(pid=83231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}